-- Logs begin at Thu 2022-06-16 17:38:15 UTC, end at Thu 2022-06-16 18:51:50 UTC. -- Jun 16 18:19:32.102311 dv-cinder-813229-10-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jun 16 18:19:32.110819 dv-cinder-813229-10-iscsi devstack@n-api.service[103100]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jun 16 18:19:32.112824 dv-cinder-813229-10-iscsi devstack@n-api.service[103100]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Jun 16 18:19:32 2022] *** Jun 16 18:19:32.112824 dv-cinder-813229-10-iscsi devstack@n-api.service[103100]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 16 18:19:32.112824 dv-cinder-813229-10-iscsi devstack@n-api.service[103100]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 16 18:19:32.112824 dv-cinder-813229-10-iscsi devstack@n-api.service[103100]: nodename: dv-cinder-813229-10-iscsi Jun 16 18:19:32.112824 dv-cinder-813229-10-iscsi devstack@n-api.service[103100]: machine: x86_64 Jun 16 18:19:32.112824 dv-cinder-813229-10-iscsi devstack@n-api.service[103100]: clock source: unix Jun 16 18:19:32.112824 dv-cinder-813229-10-iscsi devstack@n-api.service[103100]: pcre jit disabled Jun 16 18:19:32.112824 dv-cinder-813229-10-iscsi devstack@n-api.service[103100]: detected number of CPU cores: 4 Jun 16 18:19:32.112824 dv-cinder-813229-10-iscsi devstack@n-api.service[103100]: current working directory: / Jun 16 18:19:32.112824 dv-cinder-813229-10-iscsi devstack@n-api.service[103100]: detected binary path: /usr/bin/uwsgi-core Jun 16 18:19:32.113450 dv-cinder-813229-10-iscsi devstack@n-api.service[103100]: your processes number limit is 47680 Jun 16 18:19:32.113450 dv-cinder-813229-10-iscsi devstack@n-api.service[103100]: your memory page size is 4096 bytes Jun 16 18:19:32.113450 dv-cinder-813229-10-iscsi devstack@n-api.service[103100]: detected max file descriptor number: 2048 Jun 16 18:19:32.113450 dv-cinder-813229-10-iscsi devstack@n-api.service[103100]: lock engine: pthread robust mutexes Jun 16 18:19:32.113450 dv-cinder-813229-10-iscsi devstack@n-api.service[103100]: thunder lock: enabled Jun 16 18:19:32.113450 dv-cinder-813229-10-iscsi devstack@n-api.service[103100]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jun 16 18:19:32.113450 dv-cinder-813229-10-iscsi devstack@n-api.service[103100]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 16 18:19:32.157939 dv-cinder-813229-10-iscsi devstack@n-api.service[103100]: Python main interpreter initialized at 0x562a32d6c9c0 Jun 16 18:19:32.157939 dv-cinder-813229-10-iscsi devstack@n-api.service[103100]: python threads support enabled Jun 16 18:19:32.157939 dv-cinder-813229-10-iscsi devstack@n-api.service[103100]: your server socket listen backlog is limited to 100 connections Jun 16 18:19:32.157939 dv-cinder-813229-10-iscsi devstack@n-api.service[103100]: your mercy for graceful operations on workers is 90 seconds Jun 16 18:19:32.158376 dv-cinder-813229-10-iscsi devstack@n-api.service[103100]: mapped 403077 bytes (393 KB) for 2 cores Jun 16 18:19:32.158376 dv-cinder-813229-10-iscsi devstack@n-api.service[103100]: *** Operational MODE: preforking *** Jun 16 18:19:32.158655 dv-cinder-813229-10-iscsi devstack@n-api.service[103100]: *** uWSGI is running in multiple interpreter mode *** Jun 16 18:19:32.158655 dv-cinder-813229-10-iscsi devstack@n-api.service[103100]: spawned uWSGI master process (pid: 103100) Jun 16 18:19:32.158867 dv-cinder-813229-10-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jun 16 18:19:32.159711 dv-cinder-813229-10-iscsi devstack@n-api.service[103100]: spawned uWSGI worker 1 (pid: 103101, cores: 1) Jun 16 18:19:32.159841 dv-cinder-813229-10-iscsi devstack@n-api.service[103100]: spawned uWSGI worker 2 (pid: 103102, cores: 1) Jun 16 18:19:32.159947 dv-cinder-813229-10-iscsi devstack@n-api.service[103100]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 16 18:19:32.834031 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 16 18:19:32.834634 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 16 18:19:34.034700 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 16 18:19:34.034700 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: from cryptography.utils import int_from_bytes Jun 16 18:19:34.035482 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 16 18:19:34.035482 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: from cryptography.utils import int_from_bytes Jun 16 18:19:34.037200 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 16 18:19:34.037200 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: from cryptography.utils import int_from_bytes Jun 16 18:19:34.037643 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 16 18:19:34.037643 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: from cryptography.utils import int_from_bytes Jun 16 18:19:36.663972 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 16 18:19:36.664613 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 16 18:19:36.665158 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 16 18:19:36.665279 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 16 18:19:36.665443 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 16 18:19:36.665834 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:19:36.666160 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:19:36.666484 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:19:36.666806 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:19:36.667133 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:19:36.667694 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:19:36.668015 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:19:36.668359 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:19:36.668691 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:19:36.668945 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:19:36.669259 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:19:36.669579 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-813229-10-iscsi {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:19:36.669903 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:19:36.670017 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 16 18:19:36.670396 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:19:36.670489 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 16 18:19:36.670695 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:19:36.670787 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 16 18:19:36.670880 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:19:36.671095 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:19:36.671185 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 16 18:19:36.671368 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 16 18:19:36.671466 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:19:36.671722 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:19:36.671833 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:19:36.672066 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:19:36.672238 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:19:36.672406 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:19:36.673582 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:19:36.673718 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:19:36.673798 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:19:36.673870 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:19:36.673935 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:19:36.673998 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:19:36.674074 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:19:36.674145 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:19:36.674215 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:19:36.674280 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:19:36.674355 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:19:36.674425 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:19:36.674594 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:19:36.674671 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:19:36.674826 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:19:36.674914 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:19:36.675132 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:19:36.675234 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-813229-10-iscsi {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:19:36.675439 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:19:36.675536 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:19:36.675747 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:19:36.675842 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-813229-10-iscsi {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:19:36.676081 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:19:36.676186 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:19:36.676408 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:19:36.676499 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:19:36.676717 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:19:36.676807 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:19:36.677042 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:19:36.677166 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:19:36.677351 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:19:36.677475 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:19:36.677784 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:19:36.677888 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:19:36.678105 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:19:36.678225 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:19:36.678427 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:19:36.678563 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:19:36.678750 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:19:36.678908 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:19:36.679622 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:19:36.679800 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:19:36.680076 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:19:36.680309 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:19:36.680487 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:19:36.680851 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:19:36.680991 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:19:36.681184 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:19:36.681321 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:19:36.681492 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:19:36.681619 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:19:36.681806 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:19:36.681931 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:19:36.682121 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:19:36.682251 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-813229-10-iscsi {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:19:36.682440 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:19:36.682580 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:19:36.682748 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:19:36.682886 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:19:36.683062 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:19:36.683193 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:19:36.683319 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:19:36.683569 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:19:36.683703 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:19:36.683888 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:19:36.684022 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:19:36.684232 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:19:36.684364 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:19:36.684561 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:19:36.684698 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:19:36.684824 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:19:36.684961 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:19:36.685090 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:19:36.685297 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:19:36.685428 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:19:36.685568 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:19:36.685696 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:19:36.685824 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:19:36.685952 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:19:36.686130 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:19:36.686268 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:19:36.686455 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:19:36.686580 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:19:36.686762 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:19:36.686894 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:19:36.687074 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:19:36.687212 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:19:36.687388 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:19:36.687522 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:19:36.687702 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:19:36.687824 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:19:36.688008 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:19:36.688165 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:19:36.688341 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:19:36.688480 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:19:36.688602 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:19:36.688722 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:19:36.688897 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:19:36.689031 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:19:36.689222 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:19:36.689354 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:19:36.689545 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:19:36.689670 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:19:36.689870 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:19:36.690005 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.30 {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:19:36.690133 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:19:36.690263 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.30 {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:19:36.690391 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:19:36.690519 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:19:36.690677 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:19:36.690809 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:19:36.691003 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:19:36.691135 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:19:36.691314 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:19:36.691450 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:19:36.691624 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:19:36.691754 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:19:36.691932 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:19:36.692077 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:19:36.692347 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:19:36.692484 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:19:36.692589 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:19:36.692701 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:19:36.692858 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:19:36.692989 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:19:36.693165 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:19:36.693299 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:19:36.693475 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:19:36.693607 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:19:36.693795 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:19:36.693926 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:19:36.694075 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:19:36.694212 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:19:36.694376 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:19:36.694516 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:19:36.694749 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:19:36.694951 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:19:36.695179 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:19:36.695319 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:19:36.695507 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.30 {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:19:36.695698 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.30 {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:19:36.695833 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:19:36.696014 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:19:36.696198 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:19:36.696382 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:19:36.696515 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:19:36.696707 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:19:36.696837 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:19:36.697019 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:19:36.697157 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:19:36.697330 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:19:36.697454 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:19:36.697640 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:19:36.697771 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:19:36.697946 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:19:36.698080 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:19:36.698251 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:19:36.698381 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:19:36.698555 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:19:36.698683 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:19:36.698862 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:19:36.698986 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:19:36.699166 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:19:36.699295 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:19:36.699471 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:19:36.699603 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:19:36.699733 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:19:36.699859 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:19:36.700026 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:19:36.700171 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:19:36.700356 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:19:36.700481 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:19:36.700677 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:19:36.700809 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:19:36.700986 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:19:36.701117 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:19:36.701311 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:19:36.701439 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:19:36.701569 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:19:36.701689 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:19:36.701876 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:19:36.702001 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:19:36.702180 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:19:36.702310 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:19:36.702483 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:19:36.702614 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:19:36.702790 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:19:36.702914 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:19:36.703093 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:19:36.703216 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:19:36.703400 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:19:36.703530 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:19:36.703707 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:19:36.703838 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:19:36.704013 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:19:36.704226 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:19:36.704361 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:19:36.704482 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:19:36.704633 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:19:36.704766 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:19:36.704939 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:19:36.705074 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:19:36.705256 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:19:36.705379 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:19:36.705563 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:19:36.705691 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:19:36.705870 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:19:36.705970 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:19:36.706173 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:19:36.706274 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:19:36.706479 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:19:36.706620 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:19:36.706783 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:19:36.706926 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:19:36.707086 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:19:36.707209 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:19:36.707385 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:19:36.707508 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:19:36.707688 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:19:36.707825 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:19:36.707990 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:19:36.708276 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:19:36.708406 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:19:36.708538 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:19:36.708643 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:19:36.708911 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:19:36.709045 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:19:36.709243 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:19:36.709468 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:19:36.709599 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:19:36.709855 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:19:36.710026 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:19:36.710747 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.711037 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:19:36.711172 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.711414 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.711548 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:19:36.711733 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.711858 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:19:36.712101 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.712232 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:19:36.712422 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:19:36.712558 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.712742 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.712871 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:19:36.713056 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:19:36.713181 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.713371 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:19:36.713505 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.713686 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:19:36.713818 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.713996 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.714126 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:19:36.714304 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:19:36.714428 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.714611 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.714741 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:19:36.714916 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:19:36.715046 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.715234 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.715357 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:19:36.715558 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:19:36.715781 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.715906 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.716031 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:19:36.716185 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:19:36.716308 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.716493 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:19:36.716611 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.716810 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.716940 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:19:36.717152 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.717288 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.717489 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.717613 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.717839 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.717975 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.718159 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.718285 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.718497 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.718647 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.718832 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.718964 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.719155 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.719274 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.719472 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.719606 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.719788 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.719921 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.720141 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.720271 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.720458 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.720582 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.720773 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.720911 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.721087 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.721212 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.721409 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.721541 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.721730 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.721863 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.722047 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.722169 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.722359 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.722491 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.722670 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.722806 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.722980 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.723105 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.723291 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.723560 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.723774 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.723905 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.724019 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.724250 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.724361 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.724568 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.724873 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.724998 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.725186 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.725466 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.725589 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.725895 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.726652 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.726781 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.726997 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.727120 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.727306 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.727430 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.727613 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.727770 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.727925 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.728128 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.728256 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.728454 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.728587 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.728775 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.728900 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.729096 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.729227 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.729424 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.729550 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.729764 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.729896 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.730080 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.730214 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.730404 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.730534 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.730717 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.730853 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.731025 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.731160 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.731336 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.731459 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.731645 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.731767 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.731953 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.732101 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.732305 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.732431 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.732618 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.732749 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.732927 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.733061 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.733240 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.733362 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.733552 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.733674 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.733858 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.733991 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.734169 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.734299 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.734479 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.734609 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.734786 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.734920 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.735096 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.735221 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.735403 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.735534 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.735720 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.735853 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.736126 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.736253 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.736385 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.736505 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.736683 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.736819 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.736991 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.737114 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.737315 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.737437 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.737623 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.737747 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.737938 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.738062 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.738252 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.738375 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.738558 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.738681 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.738866 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.738988 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.739169 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.739300 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.739558 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.739679 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.739798 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.739918 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.740065 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.740288 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.740411 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.740531 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.740663 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.740788 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.740958 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.741093 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.741263 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.741406 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.741620 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.741745 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.742022 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.742157 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.742282 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.742414 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.742536 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.742662 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.742843 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.742976 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.743152 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.743276 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.743477 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.743588 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.743845 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.743971 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.744333 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.744461 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.744594 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.744716 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.744849 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.744971 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.745091 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.745211 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.745392 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.745517 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.745710 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.745834 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.746034 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.746233 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.746360 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.746491 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.746623 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.746752 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.746926 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.747051 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.747235 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.747368 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.747543 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.747656 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.747856 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.747981 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.748189 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.748328 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.748500 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.748632 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.748809 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.749085 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.749210 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.749412 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.749691 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.749809 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.750033 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.750163 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.750345 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.750477 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.750653 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.750786 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.750960 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.751092 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.751310 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.751435 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.751618 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.751743 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.751931 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.752073 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.752284 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.752414 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.752597 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.752721 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.752911 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.753043 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.753228 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.753353 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.753540 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.753664 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.753854 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.753991 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.754185 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.754314 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.754465 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.754590 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.754774 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.754905 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.755094 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.755217 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.755401 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.755523 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.755718 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.755854 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.756025 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.756185 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.756386 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.756511 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.756673 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.756810 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.757082 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.757269 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.757631 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.757774 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.757950 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.758111 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.758236 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.758453 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.758611 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.758835 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.758958 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.759152 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.759277 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.759464 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.759593 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.759774 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.759904 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.760107 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.760236 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.760423 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.760547 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.760737 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.760874 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.761049 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.761171 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.761361 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.761491 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.761669 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.761805 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.761985 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.762107 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.762296 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.762419 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.762599 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.762735 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.762905 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.763029 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.763223 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.763346 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.763531 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.763656 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.763842 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.763967 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.764191 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.764332 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.764506 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.764630 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.764806 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.764931 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.765124 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.765256 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.765424 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.765558 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.765734 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.765860 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.766041 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.766166 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.766346 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.766563 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.766689 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.766819 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.766941 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.767068 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.767241 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.767366 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.767558 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.767683 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.767870 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.768003 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.768205 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.768331 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.768515 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.768641 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.768830 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.768961 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.769140 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.769271 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.769444 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.769568 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.769750 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.769882 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.770063 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.770185 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.770371 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.770505 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.770721 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.770920 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.771044 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.771164 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.771283 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.771415 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.771588 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.771712 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.771895 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.772018 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.772232 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.772356 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.772542 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.773287 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.773426 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.773548 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.773698 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.773823 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.774009 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.774154 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.774357 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.774481 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.774672 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.774980 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.775115 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.775299 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.775424 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.775628 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.775752 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.775941 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.776097 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.776292 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.776417 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.776610 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.776750 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.776926 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.777029 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.777253 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.777382 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.777568 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.777700 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.777880 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.778016 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.778192 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.778315 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.778500 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.778625 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.778808 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.778941 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.779117 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.779241 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.779418 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.779546 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.779724 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.779857 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.780027 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.780181 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.780361 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.780485 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.780666 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.780793 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.780970 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.781095 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.781273 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.781399 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.781600 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.781849 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.781982 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.782167 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.782292 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.782525 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.782664 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.782786 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.782907 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.783087 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.783212 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.783401 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.783538 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.783703 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.783828 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.784004 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.784152 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.784333 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.784460 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.784675 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.784812 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.784977 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.785102 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.785287 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.785411 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.785603 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.785737 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.785917 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.786050 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.786226 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.786364 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.786532 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.786671 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.786862 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.786987 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.787137 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.787275 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.787437 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.787689 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.787797 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.787916 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.788037 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.788207 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.788962 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.789115 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.789309 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.789497 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.789671 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.789858 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.790024 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.790194 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.790365 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.790525 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.790691 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.790847 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.791009 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.791164 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.791317 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.791471 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.791643 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.791810 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.791941 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.792084 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.792514 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.792644 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.792828 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.793010 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.793135 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.793435 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.793558 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.793745 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.794044 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.794178 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.794351 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.794571 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.794695 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.794957 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.795092 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.795257 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.795516 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.795641 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.795850 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.796024 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.796182 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.796497 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.796685 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.796810 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.797116 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.797253 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.797428 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.797719 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.797843 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.798023 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.798159 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.798331 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.798455 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.798634 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.798765 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.798937 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.799072 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.799244 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.799566 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.799697 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.799883 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.800127 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.800270 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.800460 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.800586 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.800778 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.800904 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.801155 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.801293 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.801416 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.801521 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.801682 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.801807 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.801985 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.802112 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.802290 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.802414 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.802593 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.802718 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.802895 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.803020 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.803199 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.803324 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.803513 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.803628 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.803818 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.804509 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.804647 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.804811 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.804975 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.805088 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.805286 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.805414 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.805603 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.805728 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.805912 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.806045 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.806225 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.806349 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.806537 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.806661 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.806847 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.806980 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.807187 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.807312 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.807479 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.807598 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.807788 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.807921 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.808119 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.808248 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.808434 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.808559 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.808743 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.808881 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.809051 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.809177 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.809365 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.809490 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.809667 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.809799 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.809973 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.810097 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.810294 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.810417 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.810612 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.810736 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.810898 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.811023 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.811206 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.811329 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.811516 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.811643 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.811830 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.811953 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.812160 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.812294 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.812472 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.812595 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.812776 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.812899 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.813083 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.813207 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.813391 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.813516 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.813697 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.813820 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.814010 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.814143 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.814315 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.814438 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.814623 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.814748 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.814928 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.815061 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.815238 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.815361 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.815545 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.815676 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.815854 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.815991 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.816176 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.816464 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.816589 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.816796 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.817014 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.817151 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.817400 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.817554 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.817709 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.818012 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.818144 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.818322 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.818606 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.818730 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.819055 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.819179 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.819368 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.819697 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.819967 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.820238 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.820352 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.821103 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.821239 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.821424 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.821720 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.821845 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.822058 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.822212 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.822369 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.822699 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.822822 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.823096 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.823218 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.823417 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.823693 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.823813 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.824029 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.824227 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.824352 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.824660 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.824776 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.824990 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.825236 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.825361 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.825597 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.825756 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.825907 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.826235 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.826359 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.826544 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.826726 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.826864 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.827220 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.827360 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.827575 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.827701 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.827885 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.828213 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.828343 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.828634 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.828769 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.828946 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.829188 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.829321 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.829586 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.829709 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.829911 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.830164 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.830296 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.830523 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.830654 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.830835 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.831141 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.831265 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.831476 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.831607 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.831790 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.832126 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.832252 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.832504 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.832634 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.832909 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.833094 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.833325 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.833614 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.833750 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.833963 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.834112 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.834499 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.834624 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.834836 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.835076 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.835319 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.835607 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.835888 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.836164 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.836491 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.836631 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.836948 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.837277 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.837495 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.837772 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.837911 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.838314 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.838613 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.838754 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.838981 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.839245 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.839415 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.839754 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.839944 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.840290 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.840418 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.840689 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.840838 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.841022 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.841269 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.841607 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.841939 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.842227 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.842432 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.842559 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.842863 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.842989 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.843210 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.843480 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.843617 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.843865 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.844004 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.844333 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.844464 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.844586 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.844854 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.845126 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.845303 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.845426 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.845546 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.845772 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.845947 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.846080 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.846342 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.846519 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.846722 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.846853 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.847051 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.847296 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.847427 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.847717 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.847851 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.848037 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.848538 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.848765 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.848765 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.849125 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.849318 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.849318 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.850544 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.850679 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.850827 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.850960 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.850960 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.850960 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.851377 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.851542 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.851647 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.851777 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.851777 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.852138 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.852452 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.852620 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.852790 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.852955 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.853110 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.853264 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.853441 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.853610 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.853776 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.853958 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.854125 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.854296 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.854469 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.854646 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.854812 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.854812 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.855134 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.855300 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.855464 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.855620 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.855776 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.855939 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.856136 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.856319 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.856505 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.856674 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.856841 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.857009 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.857178 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.857354 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.857526 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.857719 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.857860 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.858060 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.858199 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.858328 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.858458 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.858588 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.858718 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.858841 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.858841 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.859085 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.859207 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.859207 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.859432 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.859552 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.859723 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.859847 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.859847 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.860101 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.860236 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.860358 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.860486 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.860699 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.860822 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.861263 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.861385 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.861595 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.861742 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.861914 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.862228 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.862359 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.862541 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.862719 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.862843 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.863163 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.863286 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.863544 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.863677 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.863813 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.864096 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.864225 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.864411 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.864688 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.864815 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.865054 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.865214 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.865365 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.865552 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.865710 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.865926 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.866085 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.866266 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.866938 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.867122 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.867340 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.867520 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.867684 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.867854 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.868025 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.868353 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.868616 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.868786 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.868951 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.869106 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.869261 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.869417 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.869586 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.869757 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.869928 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.870096 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.870265 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.870440 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.870628 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.870804 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.870985 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.871117 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.871239 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.871239 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.871480 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.871602 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.871730 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.871851 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.871972 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.872125 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.872258 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.872575 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.872701 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.872896 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.873075 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.873245 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.873518 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.873645 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.873837 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.874041 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.874372 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.874498 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.874686 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.874985 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.875112 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.875334 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.875465 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.875659 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.875920 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.876066 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.876311 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.876434 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.876642 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.876909 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.877034 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.877224 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.877392 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.877525 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.877831 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.877963 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.878137 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.878412 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.878590 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.878752 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.878916 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.879072 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.879227 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.879425 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.879617 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.879794 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.879973 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.880257 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.880428 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.880599 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.880766 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.880952 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.881127 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.881290 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.881455 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.881619 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.881775 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.881941 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.882152 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.882313 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.883067 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.883245 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.883411 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.883603 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.883784 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.883965 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.884167 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.884361 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.884497 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.884610 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.884761 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.884887 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.885075 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.885258 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.885402 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.885686 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.885809 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.885992 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.886245 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.886370 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.886596 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.886744 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.886924 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.887233 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.887356 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.887541 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.887726 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.887852 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.888177 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.888306 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.888498 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.888723 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.888860 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.889092 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.889227 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.889400 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.889692 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.889826 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.890007 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.890316 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.890550 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.890684 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.890920 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.891101 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.891228 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.891521 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.891645 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.891886 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.892132 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.892306 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.892458 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.892626 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.892791 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.892947 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.893111 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.893282 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.893454 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.893622 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.893791 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.893961 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.894140 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.894321 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.894492 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.894673 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.894834 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.895096 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.895096 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.895400 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.895400 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.895695 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.895843 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.896004 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.896195 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.896368 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.896535 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.896721 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.896902 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.897101 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.897302 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.897430 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.897554 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.897749 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.897942 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.898142 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.898269 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.898477 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.898715 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.898858 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.899096 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.899201 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.899411 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.899689 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.899796 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.900024 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.900205 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.900359 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.900673 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.900762 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.900986 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.901170 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.901297 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.901608 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.901694 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.901920 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.902130 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.902227 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.902531 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.902623 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.902851 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.903085 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.903197 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.903527 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.903620 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.903844 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.904113 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.904213 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.904501 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.904678 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.904818 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.905132 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.905282 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.905444 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.905648 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.905790 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.906056 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.906197 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.906387 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.906531 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.906702 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.907009 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.907161 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.907364 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.908027 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.908214 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.908365 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.908501 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.908636 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.908789 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.909023 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.909023 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.909309 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.909443 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.909578 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.909731 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.909869 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.910012 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.910149 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.910292 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.910428 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.910563 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.910697 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.910697 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.911036 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.911172 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.911307 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.911453 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.911587 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.911730 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.911865 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.912000 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.912188 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.912423 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.912570 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.912707 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.912849 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.912985 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.913120 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.913279 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.913458 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.913654 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.913992 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.914325 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.914466 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.914648 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.914799 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.914961 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.915104 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.915289 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.915432 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.915601 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.915757 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.915910 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.916068 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.916246 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.916389 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.916563 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.916706 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.916872 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.917022 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.917165 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.917561 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.917734 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.917878 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.918047 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.918191 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.918356 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.918498 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.918670 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.918813 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.918977 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.919202 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.919351 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.919485 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.919635 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.919771 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.919906 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.920088 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.920243 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.920392 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.920530 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.920666 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.920858 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.921249 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.921461 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.921639 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.921787 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.921787 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.922058 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.922058 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.922331 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.922476 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.922611 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.922747 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.922882 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.923017 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.923151 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.923293 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.923429 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.923564 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.923698 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.923840 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.923994 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.924183 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.924328 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.924509 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.924652 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.924839 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.924995 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.925133 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.925267 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.925445 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.925587 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.925755 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.925904 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.926052 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.926188 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.926366 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.926636 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.926784 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.926921 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.927064 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.927201 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.927336 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.927471 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.927613 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.927756 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.927928 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.928184 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.928330 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.928526 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.928681 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.929420 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.929658 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.929826 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.930030 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.930219 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.930486 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.930630 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.930833 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.931001 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.931140 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.931387 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.931533 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.931677 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.931813 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.931955 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.932134 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.932314 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.932473 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.932612 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.932754 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.932946 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.933112 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.933259 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.933395 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.933530 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.933664 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.933798 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.933942 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.934078 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.934213 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.934363 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.934506 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.934669 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.934830 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.935020 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.935163 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.935353 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.935495 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.935669 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.935819 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.935983 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.936163 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.936310 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.936447 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.936595 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 16 18:19:36.936732 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.936965 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.937289 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.937603 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.937917 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.938231 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.938544 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.938862 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.939196 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.939592 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.939824 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.940283 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.940599 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.940919 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.941243 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.941556 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.941879 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.942204 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.942522 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.942847 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.943155 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.943952 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.943952 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.944197 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.944596 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.945579 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.945894 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.946208 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.946528 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.946853 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.947163 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.947495 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.947863 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.948452 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.948452 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.948791 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.949122 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.949429 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.949743 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.950055 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.950359 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.950666 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.950972 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.951277 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.951583 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.951894 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.952232 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.952541 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.952847 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.953154 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.953457 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.953796 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.954128 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.954447 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.954771 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.955084 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.955411 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.955722 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.956064 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.956389 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.956714 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.957025 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.957360 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.957672 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.957987 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.958298 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.958612 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.958922 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.959235 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.959565 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.959896 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.960757 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.961092 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.961416 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.961741 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.962061 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.962375 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.962708 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.963022 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.963334 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.963654 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.963966 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.964307 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.964629 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.964949 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.965280 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.965607 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.965921 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.966249 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.966579 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.966936 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.967253 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.967601 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.967931 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.968275 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.968590 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.968900 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:19:36.969149 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 16 18:19:37.001450 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: INFO dbcounter [None req-f4441992-b892-40c2-b2e7-e67d2f52d776 None None] Registered counter for database nova_api Jun 16 18:19:37.024282 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG oslo_db.sqlalchemy.engines [None req-f4441992-b892-40c2-b2e7-e67d2f52d776 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103102) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 18:19:37.031085 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG dbcounter [-] [103102] Writer thread running {{(pid=103102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 18:19:37.031761 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: INFO dbcounter [None req-3dc5f220-8f24-417c-a74c-3b81ff707e58 None None] Registered counter for database nova_api Jun 16 18:19:37.053023 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG oslo_db.sqlalchemy.engines [None req-3dc5f220-8f24-417c-a74c-3b81ff707e58 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103101) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 18:19:37.059805 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG dbcounter [-] [103101] Writer thread running {{(pid=103101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 18:19:37.091193 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.context [None req-f4441992-b892-40c2-b2e7-e67d2f52d776 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),aeb18649-0c63-4d1d-a910-334eb7a21817(cell1) {{(pid=103102) load_cells /opt/stack/nova/nova/context.py:464}} Jun 16 18:19:37.095311 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG oslo_concurrency.lockutils [None req-f4441992-b892-40c2-b2e7-e67d2f52d776 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:19:37.096912 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG oslo_concurrency.lockutils [None req-f4441992-b892-40c2-b2e7-e67d2f52d776 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:19:37.097690 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG oslo_concurrency.lockutils [None req-f4441992-b892-40c2-b2e7-e67d2f52d776 None None] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:19:37.099639 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG oslo_concurrency.lockutils [None req-f4441992-b892-40c2-b2e7-e67d2f52d776 None None] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:19:37.102196 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: INFO dbcounter [None req-f4441992-b892-40c2-b2e7-e67d2f52d776 None None] Registered counter for database nova_cell0 Jun 16 18:19:37.105974 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: INFO dbcounter [None req-f4441992-b892-40c2-b2e7-e67d2f52d776 None None] Registered counter for database nova_cell1 Jun 16 18:19:37.113882 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG oslo_db.sqlalchemy.engines [None req-f4441992-b892-40c2-b2e7-e67d2f52d776 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103102) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 18:19:37.115702 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG oslo_db.sqlalchemy.engines [None req-f4441992-b892-40c2-b2e7-e67d2f52d776 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103102) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 18:19:37.120165 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.context [None req-3dc5f220-8f24-417c-a74c-3b81ff707e58 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),aeb18649-0c63-4d1d-a910-334eb7a21817(cell1) {{(pid=103101) load_cells /opt/stack/nova/nova/context.py:464}} Jun 16 18:19:37.122224 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG dbcounter [-] [103102] Writer thread running {{(pid=103102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 18:19:37.124345 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG oslo_concurrency.lockutils [None req-3dc5f220-8f24-417c-a74c-3b81ff707e58 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:19:37.125944 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG oslo_concurrency.lockutils [None req-3dc5f220-8f24-417c-a74c-3b81ff707e58 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:19:37.126730 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG oslo_concurrency.lockutils [None req-3dc5f220-8f24-417c-a74c-3b81ff707e58 None None] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:19:37.127314 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG dbcounter [-] [103102] Writer thread running {{(pid=103102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 18:19:37.128719 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG oslo_concurrency.lockutils [None req-3dc5f220-8f24-417c-a74c-3b81ff707e58 None None] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103101) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:19:37.130718 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: INFO dbcounter [None req-3dc5f220-8f24-417c-a74c-3b81ff707e58 None None] Registered counter for database nova_cell0 Jun 16 18:19:37.135168 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: INFO dbcounter [None req-3dc5f220-8f24-417c-a74c-3b81ff707e58 None None] Registered counter for database nova_cell1 Jun 16 18:19:37.142612 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG oslo_db.sqlalchemy.engines [None req-3dc5f220-8f24-417c-a74c-3b81ff707e58 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103101) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 18:19:37.146067 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG oslo_db.sqlalchemy.engines [None req-3dc5f220-8f24-417c-a74c-3b81ff707e58 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103101) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 18:19:37.150981 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG dbcounter [-] [103101] Writer thread running {{(pid=103101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 18:19:37.277732 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: INFO dbcounter [None req-f4441992-b892-40c2-b2e7-e67d2f52d776 None None] Registered counter for database nova_cell0 Jun 16 18:19:37.286480 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG oslo_db.sqlalchemy.engines [None req-f4441992-b892-40c2-b2e7-e67d2f52d776 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103102) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 18:19:37.291820 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG dbcounter [-] [103102] Writer thread running {{(pid=103102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 18:19:37.312158 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG dbcounter [-] [103101] Writer thread running {{(pid=103101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 18:19:37.323311 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: INFO dbcounter [None req-3dc5f220-8f24-417c-a74c-3b81ff707e58 None None] Registered counter for database nova_cell0 Jun 16 18:19:37.332704 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG oslo_db.sqlalchemy.engines [None req-3dc5f220-8f24-417c-a74c-3b81ff707e58 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103101) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 18:19:37.338449 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG dbcounter [-] [103101] Writer thread running {{(pid=103101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 18:19:37.634830 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: WARNING keystonemiddleware.auth_token [None req-f4441992-b892-40c2-b2e7-e67d2f52d776 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 16 18:19:37.642191 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: WARNING keystonemiddleware.auth_token [None req-f4441992-b892-40c2-b2e7-e67d2f52d776 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 16 18:19:37.667026 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: WARNING keystonemiddleware.auth_token [None req-3dc5f220-8f24-417c-a74c-3b81ff707e58 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 16 18:19:37.674667 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: WARNING keystonemiddleware.auth_token [None req-3dc5f220-8f24-417c-a74c-3b81ff707e58 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 16 18:19:37.987646 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: WARNING keystonemiddleware.auth_token [None req-f4441992-b892-40c2-b2e7-e67d2f52d776 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 16 18:19:37.993851 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: WARNING keystonemiddleware.auth_token [None req-f4441992-b892-40c2-b2e7-e67d2f52d776 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 16 18:19:37.998964 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x562a32d6c9c0 pid: 103102 (default app) Jun 16 18:19:38.001092 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi [None req-f4441992-b892-40c2-b2e7-e67d2f52d776 None None] Calling method '>' {{(pid=103102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:19:38.002309 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: INFO nova.api.openstack.requestlog [None req-f4441992-b892-40c2-b2e7-e67d2f52d776 None None] 10.222.0.30 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001796 Jun 16 18:19:38.002732 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: [pid: 103102|app: 0|req: 1/1] 10.222.0.30 () {50 vars in 788 bytes} [Thu Jun 16 18:19:37 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:19:38.020580 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: WARNING keystonemiddleware.auth_token [None req-3dc5f220-8f24-417c-a74c-3b81ff707e58 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 16 18:19:38.027513 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: WARNING keystonemiddleware.auth_token [None req-3dc5f220-8f24-417c-a74c-3b81ff707e58 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 16 18:19:38.032851 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x562a32d6c9c0 pid: 103101 (default app) Jun 16 18:20:59.603788 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi [None req-f4441992-b892-40c2-b2e7-e67d2f52d776 None None] Calling method '>' {{(pid=103102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:20:59.605630 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: INFO nova.api.openstack.requestlog [None req-f4441992-b892-40c2-b2e7-e67d2f52d776 None None] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002257 Jun 16 18:20:59.611231 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: [pid: 103102|app: 0|req: 2/2] 10.222.0.30 () {54 vars in 930 bytes} [Thu Jun 16 18:20:59 2022] GET /compute/v2.1 => generated 388 bytes in 8 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:20:59.618714 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG dbcounter [-] [103101] Writing DB stats nova_api:SELECT=3 {{(pid=103101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:20:59.619998 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG dbcounter [-] [103101] Writing DB stats nova_cell0:SELECT=3 {{(pid=103101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:20:59.620884 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG dbcounter [-] [103101] Writing DB stats nova_cell1:SELECT=3 {{(pid=103101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:20:59.621709 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG dbcounter [-] [103101] Writing DB stats nova_cell0:SELECT=3 {{(pid=103101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:21:00.081992 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi [None req-9753a5df-9179-4831-91d0-6e1115c955b9 admin admin] Calling method '>' {{(pid=103101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:21:00.111287 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: INFO nova.api.openstack.requestlog [None req-9753a5df-9179-4831-91d0-6e1115c955b9 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.497620 Jun 16 18:21:00.112235 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: [pid: 103101|app: 0|req: 1/3] 10.222.0.30 () {60 vars in 1291 bytes} [Thu Jun 16 18:20:59 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:21:02.373841 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi [None req-f4441992-b892-40c2-b2e7-e67d2f52d776 None None] Calling method '>' {{(pid=103102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:21:02.375319 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: INFO nova.api.openstack.requestlog [None req-f4441992-b892-40c2-b2e7-e67d2f52d776 None None] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001723 Jun 16 18:21:02.375472 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: [pid: 103102|app: 0|req: 3/4] 10.222.0.30 () {54 vars in 930 bytes} [Thu Jun 16 18:21:02 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:21:02.450777 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi [None req-205d285c-0b1c-4f17-9bb3-7991c7fa7b26 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "rxtx_factor": 1.0, "disk": 1, "ram": 256, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "cirros256", "vcpus": 1, "id": "c1", "swap": 0}} {{(pid=103101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:21:02.473380 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 18:21:02.473380 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: warnings.warn(msg) Jun 16 18:21:02.504009 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: INFO nova.api.openstack.requestlog [None req-205d285c-0b1c-4f17-9bb3-7991c7fa7b26 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.119616 Jun 16 18:21:02.504876 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: [pid: 103101|app: 0|req: 2/5] 10.222.0.30 () {64 vars in 1282 bytes} [Thu Jun 16 18:21:02 2022] POST /compute/v2.1/flavors => generated 407 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 16 18:21:02.724454 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi [None req-e0b6bd5d-e233-4314-ab57-1150fb75cd4e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:21:02.726774 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 18:21:02.726774 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: warnings.warn(msg) Jun 16 18:21:02.729467 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG dbcounter [-] [103102] Writing DB stats nova_api:SELECT=3 {{(pid=103102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:21:02.730433 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG dbcounter [-] [103102] Writing DB stats nova_cell1:SELECT=3 {{(pid=103102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:21:02.731246 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG dbcounter [-] [103102] Writing DB stats nova_cell0:SELECT=3 {{(pid=103102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:21:02.731947 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG dbcounter [-] [103102] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:21:02.804844 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: INFO nova.api.openstack.requestlog [None req-e0b6bd5d-e233-4314-ab57-1150fb75cd4e admin admin] 10.222.0.30 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.291162 Jun 16 18:21:02.805455 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: [pid: 103102|app: 0|req: 4/6] 10.222.0.30 () {64 vars in 1335 bytes} [Thu Jun 16 18:21:02 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:21:05.097039 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi [None req-205d285c-0b1c-4f17-9bb3-7991c7fa7b26 admin admin] Calling method '>' {{(pid=103101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:21:05.098061 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: INFO nova.api.openstack.requestlog [None req-205d285c-0b1c-4f17-9bb3-7991c7fa7b26 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001660 Jun 16 18:21:05.098686 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: [pid: 103101|app: 0|req: 3/7] 10.222.0.30 () {54 vars in 930 bytes} [Thu Jun 16 18:21:05 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:21:05.210194 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi [None req-6e911d6f-0199-40e0-af01-c4ae7d778105 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "ram": 512, "id": "d1", "name": "ds512M", "rxtx_factor": 1.0, "disk": 5}} {{(pid=103102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:21:05.228126 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 18:21:05.228126 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: warnings.warn(msg) Jun 16 18:21:05.248198 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: INFO nova.api.openstack.requestlog [None req-6e911d6f-0199-40e0-af01-c4ae7d778105 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.143535 Jun 16 18:21:05.248768 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: [pid: 103102|app: 0|req: 5/8] 10.222.0.30 () {64 vars in 1282 bytes} [Thu Jun 16 18:21:05 2022] POST /compute/v2.1/flavors => generated 404 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 18:21:05.261276 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi [None req-88e9d74e-b651-4313-a7a0-5bcb88238ee8 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:21:05.263873 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 18:21:05.263873 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: warnings.warn(msg) Jun 16 18:21:05.300632 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: INFO nova.api.openstack.requestlog [None req-88e9d74e-b651-4313-a7a0-5bcb88238ee8 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.042844 Jun 16 18:21:05.301237 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: [pid: 103101|app: 0|req: 4/9] 10.222.0.30 () {64 vars in 1335 bytes} [Thu Jun 16 18:21:05 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:21:07.548430 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi [None req-6e911d6f-0199-40e0-af01-c4ae7d778105 admin admin] Calling method '>' {{(pid=103102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:21:07.549440 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: INFO nova.api.openstack.requestlog [None req-6e911d6f-0199-40e0-af01-c4ae7d778105 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001496 Jun 16 18:21:07.549953 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: [pid: 103102|app: 0|req: 6/10] 10.222.0.30 () {54 vars in 930 bytes} [Thu Jun 16 18:21:07 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:21:07.616442 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi [None req-89197d90-a2db-465f-adc6-ba438b954f71 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "name": "ds1G", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "swap": 0, "vcpus": 1, "os-flavor-access:is_public": true, "disk": 10, "id": "d2"}} {{(pid=103101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:21:07.637865 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: INFO nova.api.openstack.requestlog [None req-89197d90-a2db-465f-adc6-ba438b954f71 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.081347 Jun 16 18:21:07.646534 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: [pid: 103101|app: 0|req: 5/11] 10.222.0.30 () {64 vars in 1282 bytes} [Thu Jun 16 18:21:07 2022] POST /compute/v2.1/flavors => generated 404 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 16 18:21:07.651916 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi [None req-d447574a-7485-40f2-8c18-c3b32df4687b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:21:07.677839 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: INFO nova.api.openstack.requestlog [None req-d447574a-7485-40f2-8c18-c3b32df4687b admin admin] 10.222.0.30 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029814 Jun 16 18:21:07.679005 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: [pid: 103102|app: 0|req: 7/12] 10.222.0.30 () {64 vars in 1335 bytes} [Thu Jun 16 18:21:07 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:21:09.941631 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi [None req-89197d90-a2db-465f-adc6-ba438b954f71 admin admin] Calling method '>' {{(pid=103101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:21:09.942673 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: INFO nova.api.openstack.requestlog [None req-89197d90-a2db-465f-adc6-ba438b954f71 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001638 Jun 16 18:21:09.943082 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: [pid: 103101|app: 0|req: 6/13] 10.222.0.30 () {54 vars in 930 bytes} [Thu Jun 16 18:21:09 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:21:10.013572 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi [None req-6692f0d8-87b9-45a9-9602-af7ea0ad69c2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "name": "ds2G", "disk": 10, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d3", "vcpus": 2, "swap": 0, "ram": 2048}} {{(pid=103102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:21:10.032268 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: INFO nova.api.openstack.requestlog [None req-6692f0d8-87b9-45a9-9602-af7ea0ad69c2 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.083069 Jun 16 18:21:10.033034 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: [pid: 103102|app: 0|req: 8/14] 10.222.0.30 () {64 vars in 1282 bytes} [Thu Jun 16 18:21:09 2022] POST /compute/v2.1/flavors => generated 404 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 18:21:10.045620 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi [None req-9f151d7f-d105-4244-9c7a-eee176e8cc7c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:21:10.069608 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: INFO nova.api.openstack.requestlog [None req-9f151d7f-d105-4244-9c7a-eee176e8cc7c admin admin] 10.222.0.30 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027814 Jun 16 18:21:10.070197 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: [pid: 103101|app: 0|req: 7/15] 10.222.0.30 () {64 vars in 1335 bytes} [Thu Jun 16 18:21:10 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:21:12.443653 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi [None req-6692f0d8-87b9-45a9-9602-af7ea0ad69c2 admin admin] Calling method '>' {{(pid=103102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:21:12.444603 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: INFO nova.api.openstack.requestlog [None req-6692f0d8-87b9-45a9-9602-af7ea0ad69c2 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001470 Jun 16 18:21:12.445217 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: [pid: 103102|app: 0|req: 9/16] 10.222.0.30 () {54 vars in 930 bytes} [Thu Jun 16 18:21:12 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:21:12.533314 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi [None req-f41ee7a3-af10-403a-a9ed-35fe288d5cd1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "id": "d4", "os-flavor-access:is_public": true, "ram": 4096, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds4G", "disk": 20, "swap": 0}} {{(pid=103101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:21:12.556910 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: INFO nova.api.openstack.requestlog [None req-f41ee7a3-af10-403a-a9ed-35fe288d5cd1 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.104820 Jun 16 18:21:12.557563 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: [pid: 103101|app: 0|req: 8/17] 10.222.0.30 () {64 vars in 1282 bytes} [Thu Jun 16 18:21:12 2022] POST /compute/v2.1/flavors => generated 404 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 18:21:12.576596 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi [None req-335051c7-3551-490d-8e7e-43c06dddf599 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:21:12.611500 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: INFO nova.api.openstack.requestlog [None req-335051c7-3551-490d-8e7e-43c06dddf599 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.041562 Jun 16 18:21:12.620074 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: [pid: 103102|app: 0|req: 10/18] 10.222.0.30 () {64 vars in 1335 bytes} [Thu Jun 16 18:21:12 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:21:15.115651 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi [None req-f41ee7a3-af10-403a-a9ed-35fe288d5cd1 admin admin] Calling method '>' {{(pid=103101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:21:15.116746 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: INFO nova.api.openstack.requestlog [None req-f41ee7a3-af10-403a-a9ed-35fe288d5cd1 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001531 Jun 16 18:21:15.117427 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: [pid: 103101|app: 0|req: 9/19] 10.222.0.30 () {54 vars in 930 bytes} [Thu Jun 16 18:21:15 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:21:15.184405 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi [None req-7aab2c0d-31d6-4744-b2cd-39030a1e0216 admin admin] Calling method '>' {{(pid=103102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:21:15.215174 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: INFO nova.api.openstack.requestlog [None req-7aab2c0d-31d6-4744-b2cd-39030a1e0216 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.091212 Jun 16 18:21:15.216090 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: [pid: 103102|app: 0|req: 11/20] 10.222.0.30 () {60 vars in 1291 bytes} [Thu Jun 16 18:21:15 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 18:21:17.474043 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi [None req-f41ee7a3-af10-403a-a9ed-35fe288d5cd1 admin admin] Calling method '>' {{(pid=103101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:21:17.475129 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: INFO nova.api.openstack.requestlog [None req-f41ee7a3-af10-403a-a9ed-35fe288d5cd1 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002216 Jun 16 18:21:17.475943 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: [pid: 103101|app: 0|req: 10/21] 10.222.0.30 () {54 vars in 930 bytes} [Thu Jun 16 18:21:17 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:21:17.557831 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi [None req-e888ed48-3751-41d5-b4a1-39ad8b4f892d admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.tiny", "disk": 1, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "id": "1", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "swap": 0, "ram": 512}} {{(pid=103102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:21:17.578330 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: INFO nova.api.openstack.requestlog [None req-e888ed48-3751-41d5-b4a1-39ad8b4f892d admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.093555 Jun 16 18:21:17.578885 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: [pid: 103102|app: 0|req: 12/22] 10.222.0.30 () {64 vars in 1282 bytes} [Thu Jun 16 18:21:17 2022] POST /compute/v2.1/flavors => generated 402 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 18:21:17.592116 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi [None req-6ddb3303-71c1-49ca-92fb-70bfff091576 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:21:17.618311 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: INFO nova.api.openstack.requestlog [None req-6ddb3303-71c1-49ca-92fb-70bfff091576 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029735 Jun 16 18:21:17.618755 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: [pid: 103101|app: 0|req: 11/23] 10.222.0.30 () {64 vars in 1332 bytes} [Thu Jun 16 18:21:17 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:21:20.180788 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi [None req-e888ed48-3751-41d5-b4a1-39ad8b4f892d admin admin] Calling method '>' {{(pid=103102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:21:20.181795 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: INFO nova.api.openstack.requestlog [None req-e888ed48-3751-41d5-b4a1-39ad8b4f892d admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001495 Jun 16 18:21:20.182236 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: [pid: 103102|app: 0|req: 13/24] 10.222.0.30 () {54 vars in 930 bytes} [Thu Jun 16 18:21:20 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:21:20.254125 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi [None req-e33652d4-8628-443b-8d28-add803d70dcc admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 20, "vcpus": 1, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "id": "2", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "name": "m1.small", "ram": 2048}} {{(pid=103101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:21:20.277813 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: INFO nova.api.openstack.requestlog [None req-e33652d4-8628-443b-8d28-add803d70dcc admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.089331 Jun 16 18:21:20.278391 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: [pid: 103101|app: 0|req: 12/25] 10.222.0.30 () {64 vars in 1282 bytes} [Thu Jun 16 18:21:20 2022] POST /compute/v2.1/flavors => generated 405 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 18:21:20.290877 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi [None req-3a3f51a6-8eac-4ce2-882f-c656c60d51db admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:21:20.316770 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: INFO nova.api.openstack.requestlog [None req-3a3f51a6-8eac-4ce2-882f-c656c60d51db admin admin] 10.222.0.30 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030096 Jun 16 18:21:20.317362 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: [pid: 103102|app: 0|req: 14/26] 10.222.0.30 () {64 vars in 1332 bytes} [Thu Jun 16 18:21:20 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:21:23.000191 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi [None req-e33652d4-8628-443b-8d28-add803d70dcc admin admin] Calling method '>' {{(pid=103101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:21:23.001225 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: INFO nova.api.openstack.requestlog [None req-e33652d4-8628-443b-8d28-add803d70dcc admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001613 Jun 16 18:21:23.001620 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: [pid: 103101|app: 0|req: 13/27] 10.222.0.30 () {54 vars in 930 bytes} [Thu Jun 16 18:21:22 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:21:23.063959 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi [None req-5c10e0d9-4393-4dd9-b358-28f99f210ace admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.medium", "rxtx_factor": 1.0, "ram": 4096, "disk": 40, "id": "3", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "vcpus": 2, "swap": 0}} {{(pid=103102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:21:23.085054 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: INFO nova.api.openstack.requestlog [None req-5c10e0d9-4393-4dd9-b358-28f99f210ace admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.076340 Jun 16 18:21:23.085616 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: [pid: 103102|app: 0|req: 15/28] 10.222.0.30 () {64 vars in 1282 bytes} [Thu Jun 16 18:21:23 2022] POST /compute/v2.1/flavors => generated 406 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 16 18:21:23.098233 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi [None req-0dbe14c6-7de6-4fc7-baa5-97a59bb77859 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:21:23.128423 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: INFO nova.api.openstack.requestlog [None req-0dbe14c6-7de6-4fc7-baa5-97a59bb77859 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033401 Jun 16 18:21:23.129006 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: [pid: 103101|app: 0|req: 14/29] 10.222.0.30 () {64 vars in 1332 bytes} [Thu Jun 16 18:21:23 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:21:25.371196 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi [None req-5c10e0d9-4393-4dd9-b358-28f99f210ace admin admin] Calling method '>' {{(pid=103102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:21:25.372620 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: INFO nova.api.openstack.requestlog [None req-5c10e0d9-4393-4dd9-b358-28f99f210ace admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001672 Jun 16 18:21:25.373167 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: [pid: 103102|app: 0|req: 16/30] 10.222.0.30 () {54 vars in 930 bytes} [Thu Jun 16 18:21:25 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:21:25.438790 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi [None req-438dd943-9558-47d0-9b0c-603e30170c6d admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "ram": 8192, "id": "4", "name": "m1.large", "vcpus": 4, "rxtx_factor": 1.0, "swap": 0, "disk": 80, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:21:25.457673 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: INFO nova.api.openstack.requestlog [None req-438dd943-9558-47d0-9b0c-603e30170c6d admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.077213 Jun 16 18:21:25.458199 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: [pid: 103101|app: 0|req: 15/31] 10.222.0.30 () {64 vars in 1282 bytes} [Thu Jun 16 18:21:25 2022] POST /compute/v2.1/flavors => generated 405 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 16 18:21:25.470694 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi [None req-dc3cdf74-cba1-40b6-a776-2802ecddd9f6 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:21:25.495597 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: INFO nova.api.openstack.requestlog [None req-dc3cdf74-cba1-40b6-a776-2802ecddd9f6 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029205 Jun 16 18:21:25.496398 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: [pid: 103102|app: 0|req: 17/32] 10.222.0.30 () {64 vars in 1332 bytes} [Thu Jun 16 18:21:25 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:21:27.766959 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi [None req-438dd943-9558-47d0-9b0c-603e30170c6d admin admin] Calling method '>' {{(pid=103101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:21:27.770591 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: INFO nova.api.openstack.requestlog [None req-438dd943-9558-47d0-9b0c-603e30170c6d admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.003751 Jun 16 18:21:27.771340 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: [pid: 103101|app: 0|req: 16/33] 10.222.0.30 () {54 vars in 930 bytes} [Thu Jun 16 18:21:27 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:21:27.846122 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi [None req-7b51fd68-1030-4ff4-99ba-92b795b593f8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "ram": 16384, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 160, "swap": 0, "id": "5", "vcpus": 8, "os-flavor-access:is_public": true, "name": "m1.xlarge"}} {{(pid=103102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:21:27.866270 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: INFO nova.api.openstack.requestlog [None req-7b51fd68-1030-4ff4-99ba-92b795b593f8 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.086143 Jun 16 18:21:27.866823 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: [pid: 103102|app: 0|req: 18/34] 10.222.0.30 () {64 vars in 1282 bytes} [Thu Jun 16 18:21:27 2022] POST /compute/v2.1/flavors => generated 408 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 18:21:27.879488 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi [None req-d35972ba-1f89-47a1-a873-0ae3a6eac3e7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:21:27.910572 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: INFO nova.api.openstack.requestlog [None req-d35972ba-1f89-47a1-a873-0ae3a6eac3e7 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.035356 Jun 16 18:21:27.911288 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: [pid: 103101|app: 0|req: 17/35] 10.222.0.30 () {64 vars in 1332 bytes} [Thu Jun 16 18:21:27 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:21:52.207524 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi [None req-7b51fd68-1030-4ff4-99ba-92b795b593f8 admin admin] Calling method '>' {{(pid=103102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:21:52.208582 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: INFO nova.api.openstack.requestlog [None req-7b51fd68-1030-4ff4-99ba-92b795b593f8 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001495 Jun 16 18:21:52.208986 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: [pid: 103102|app: 0|req: 19/36] 10.222.0.30 () {54 vars in 930 bytes} [Thu Jun 16 18:21:52 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:21:52.219582 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG dbcounter [-] [103101] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=10,nova_api:SAVEPOINT=5,nova_api:RELEASE=5 {{(pid=103101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:21:52.271147 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi [None req-9e786c0c-e4bf-494d-b066-f249c5703736 admin admin] Calling method '>' {{(pid=103101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:21:52.288675 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: INFO nova.api.openstack.requestlog [None req-9e786c0c-e4bf-494d-b066-f249c5703736 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.073586 Jun 16 18:21:52.289216 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: [pid: 103101|app: 0|req: 18/37] 10.222.0.30 () {60 vars in 1291 bytes} [Thu Jun 16 18:21:52 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:21:53.268384 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi [None req-7b51fd68-1030-4ff4-99ba-92b795b593f8 admin admin] Calling method '>' {{(pid=103102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:21:53.269394 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: INFO nova.api.openstack.requestlog [None req-7b51fd68-1030-4ff4-99ba-92b795b593f8 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001449 Jun 16 18:21:53.269799 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: [pid: 103102|app: 0|req: 20/38] 10.222.0.30 () {56 vars in 1074 bytes} [Thu Jun 16 18:21:53 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 18:21:53.467218 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi [None req-9d4ac6e6-a2b4-454a-839f-16d9d653a32c admin admin] Calling method '>' {{(pid=103101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:21:53.473747 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: INFO nova.api.openstack.wsgi [None req-9d4ac6e6-a2b4-454a-839f-16d9d653a32c admin admin] HTTP exception thrown: Flavor 42 could not be found. Jun 16 18:21:53.477062 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi [None req-9d4ac6e6-a2b4-454a-839f-16d9d653a32c admin admin] Request method failure captured: Jun 16 18:21:53.477062 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jun 16 18:21:53.477062 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: Accept: application/json Jun 16 18:21:53.477062 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: Accept-Encoding: gzip, deflate Jun 16 18:21:53.477062 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: Connection: keep-alive Jun 16 18:21:53.477062 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: Content-Length: 0 Jun 16 18:21:53.477062 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: Host: 10.222.0.30 Jun 16 18:21:53.477062 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: Openstack-Api-Version: compute 2.90 Jun 16 18:21:53.477062 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: Openstack-System-Scope: None Jun 16 18:21:53.477062 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: User-Agent: python-novaclient Jun 16 18:21:53.477062 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: X-Auth-Token: gAAAAABiq3TB7A-01ViA_rGWJiyyOLrZbkuatvxOwYvi-PBvU3j_uJoJCR2TRBkdPpvwaqd2R-CPVQ0cWMM95Mtvs9gGPbLU38J5xMveYBq9VdyFuHCDavUrC4iUJ0w9PDkhlfpbDAKWpGoI7IPFLopU_fp3K0gP9ZTE595wOMRarNlphzQm2h4 Jun 16 18:21:53.477062 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: X-Domain-Id: None Jun 16 18:21:53.477062 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: X-Domain-Name: None Jun 16 18:21:53.477062 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: X-Identity-Status: Confirmed Jun 16 18:21:53.477062 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: X-Is-Admin-Project: True Jun 16 18:21:53.477062 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: X-Openstack-Nova-Api-Version: 2.90 Jun 16 18:21:53.477062 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: X-Project-Domain-Id: default Jun 16 18:21:53.477062 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: X-Project-Domain-Name: Default Jun 16 18:21:53.477062 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: X-Project-Id: 243115c739b84006986ba2e6345f2509 Jun 16 18:21:53.477062 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: X-Project-Name: admin Jun 16 18:21:53.477062 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: X-Role: reader,admin,member Jun 16 18:21:53.477062 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: X-Roles: reader,admin,member Jun 16 18:21:53.478719 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/243115c739b84006986ba2e6345f2509"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/243115c739b84006986ba2e6345f2509"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_243115c739b84006986ba2e6345f2509", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/243115c739b84006986ba2e6345f2509"}]}] Jun 16 18:21:53.478719 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: X-Tenant: admin Jun 16 18:21:53.478719 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: X-Tenant-Id: 243115c739b84006986ba2e6345f2509 Jun 16 18:21:53.478719 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: X-Tenant-Name: admin Jun 16 18:21:53.478719 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: X-User: admin Jun 16 18:21:53.478719 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: X-User-Domain-Id: default Jun 16 18:21:53.478719 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: X-User-Domain-Name: Default Jun 16 18:21:53.478719 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: X-User-Id: bd8fd8fbb8b9467bac357373688c6910 Jun 16 18:21:53.478719 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: X-User-Name: admin Jun 16 18:21:53.478719 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: method: > Jun 16 18:21:53.478719 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: exception: Flavor 42 could not be found. Jun 16 18:21:53.478719 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: action_args: {'id': '42'} Jun 16 18:21:53.478719 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: {{(pid=103101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:21:53.478719 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:21:53.479671 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 16 18:21:53.479671 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 16 18:21:53.479671 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 16 18:21:53.479671 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 16 18:21:53.479671 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 16 18:21:53.479671 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 16 18:21:53.479671 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 16 18:21:53.479671 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 16 18:21:53.479671 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 16 18:21:53.479671 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:21:53.479671 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 16 18:21:53.479671 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 16 18:21:53.479671 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jun 16 18:21:53.479671 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: ERROR nova.api.openstack.wsgi Jun 16 18:21:53.479671 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:21:53.479671 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: ERROR nova.api.openstack.wsgi Jun 16 18:21:53.479671 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:21:53.479671 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:21:53.479671 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:21:53.480898 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:21:53.480898 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:21:53.480898 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:21:53.480898 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:21:53.480898 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 16 18:21:53.480898 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:21:53.480898 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jun 16 18:21:53.480898 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: ERROR nova.api.openstack.wsgi Jun 16 18:21:53.480898 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:21:53.480898 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: ERROR nova.api.openstack.wsgi Jun 16 18:21:53.480898 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:21:53.480898 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:21:53.480898 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:21:53.480898 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:21:53.480898 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:21:53.480898 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jun 16 18:21:53.480898 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: ERROR nova.api.openstack.wsgi Jun 16 18:21:53.480898 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi [None req-9d4ac6e6-a2b4-454a-839f-16d9d653a32c admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103101) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:21:53.481936 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: INFO nova.api.openstack.requestlog [None req-9d4ac6e6-a2b4-454a-839f-16d9d653a32c admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.064838 Jun 16 18:21:53.481936 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: [pid: 103101|app: 0|req: 19/39] 10.222.0.30 () {60 vars in 1190 bytes} [Thu Jun 16 18:21:53 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 16 18:21:53.488383 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi [None req-5282a83f-c952-44eb-a7f4-216b2b73ede3 admin admin] Calling method '>' {{(pid=103102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:21:53.491221 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG dbcounter [-] [103102] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=103102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:21:53.511858 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: INFO nova.api.openstack.requestlog [None req-5282a83f-c952-44eb-a7f4-216b2b73ede3 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.027158 Jun 16 18:21:53.512464 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: [pid: 103102|app: 0|req: 21/40] 10.222.0.30 () {60 vars in 1210 bytes} [Thu Jun 16 18:21:53 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:21:53.523008 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi [None req-8598e931-079b-4f02-9633-e8c7d98cd7cd admin admin] Calling method '>' {{(pid=103101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:21:53.545809 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: INFO nova.api.openstack.requestlog [None req-8598e931-079b-4f02-9633-e8c7d98cd7cd admin admin] 10.222.0.30 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026334 Jun 16 18:21:53.546386 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: [pid: 103101|app: 0|req: 20/41] 10.222.0.30 () {60 vars in 1210 bytes} [Thu Jun 16 18:21:53 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 18:21:53.557628 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi [None req-59ea8f47-617d-42e5-9e23-b04b02b422eb admin admin] Calling method '>' {{(pid=103102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:21:53.564319 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: INFO nova.api.openstack.wsgi [None req-59ea8f47-617d-42e5-9e23-b04b02b422eb admin admin] HTTP exception thrown: Flavor 42 could not be found. Jun 16 18:21:53.567593 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi [None req-59ea8f47-617d-42e5-9e23-b04b02b422eb admin admin] Request method failure captured: Jun 16 18:21:53.567593 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jun 16 18:21:53.567593 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: Accept: application/json Jun 16 18:21:53.567593 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: Accept-Encoding: gzip, deflate Jun 16 18:21:53.567593 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: Connection: keep-alive Jun 16 18:21:53.567593 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: Content-Length: 0 Jun 16 18:21:53.567593 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: Host: 10.222.0.30 Jun 16 18:21:53.567593 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: Openstack-Api-Version: compute 2.90 Jun 16 18:21:53.567593 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: Openstack-System-Scope: None Jun 16 18:21:53.567593 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: User-Agent: python-novaclient Jun 16 18:21:53.567593 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: X-Auth-Token: gAAAAABiq3TB7A-01ViA_rGWJiyyOLrZbkuatvxOwYvi-PBvU3j_uJoJCR2TRBkdPpvwaqd2R-CPVQ0cWMM95Mtvs9gGPbLU38J5xMveYBq9VdyFuHCDavUrC4iUJ0w9PDkhlfpbDAKWpGoI7IPFLopU_fp3K0gP9ZTE595wOMRarNlphzQm2h4 Jun 16 18:21:53.567593 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: X-Domain-Id: None Jun 16 18:21:53.567593 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: X-Domain-Name: None Jun 16 18:21:53.567593 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: X-Identity-Status: Confirmed Jun 16 18:21:53.567593 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: X-Is-Admin-Project: True Jun 16 18:21:53.567593 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: X-Openstack-Nova-Api-Version: 2.90 Jun 16 18:21:53.567593 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: X-Project-Domain-Id: default Jun 16 18:21:53.567593 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: X-Project-Domain-Name: Default Jun 16 18:21:53.567593 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: X-Project-Id: 243115c739b84006986ba2e6345f2509 Jun 16 18:21:53.567593 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: X-Project-Name: admin Jun 16 18:21:53.567593 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: X-Role: reader,admin,member Jun 16 18:21:53.567593 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: X-Roles: reader,admin,member Jun 16 18:21:53.569099 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/243115c739b84006986ba2e6345f2509"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/243115c739b84006986ba2e6345f2509"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_243115c739b84006986ba2e6345f2509", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/243115c739b84006986ba2e6345f2509"}]}] Jun 16 18:21:53.569099 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: X-Tenant: admin Jun 16 18:21:53.569099 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: X-Tenant-Id: 243115c739b84006986ba2e6345f2509 Jun 16 18:21:53.569099 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: X-Tenant-Name: admin Jun 16 18:21:53.569099 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: X-User: admin Jun 16 18:21:53.569099 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: X-User-Domain-Id: default Jun 16 18:21:53.569099 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: X-User-Domain-Name: Default Jun 16 18:21:53.569099 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: X-User-Id: bd8fd8fbb8b9467bac357373688c6910 Jun 16 18:21:53.569099 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: X-User-Name: admin Jun 16 18:21:53.569099 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: method: > Jun 16 18:21:53.569099 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: exception: Flavor 42 could not be found. Jun 16 18:21:53.569099 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: action_args: {'id': '42'} Jun 16 18:21:53.569099 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: {{(pid=103102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:21:53.569099 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:21:53.570038 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 16 18:21:53.570038 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 16 18:21:53.570038 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 16 18:21:53.570038 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 16 18:21:53.570038 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 16 18:21:53.570038 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 16 18:21:53.570038 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 16 18:21:53.570038 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 16 18:21:53.570038 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 16 18:21:53.570038 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:21:53.570038 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 16 18:21:53.570038 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 16 18:21:53.570038 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jun 16 18:21:53.570038 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: ERROR nova.api.openstack.wsgi Jun 16 18:21:53.570038 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:21:53.570038 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: ERROR nova.api.openstack.wsgi Jun 16 18:21:53.570038 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:21:53.570038 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:21:53.570038 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:21:53.571273 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:21:53.571273 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:21:53.571273 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:21:53.571273 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:21:53.571273 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 16 18:21:53.571273 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:21:53.571273 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jun 16 18:21:53.571273 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: ERROR nova.api.openstack.wsgi Jun 16 18:21:53.571273 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:21:53.571273 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: ERROR nova.api.openstack.wsgi Jun 16 18:21:53.571273 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:21:53.571273 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:21:53.571273 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:21:53.571273 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:21:53.571273 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:21:53.571273 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jun 16 18:21:53.571273 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: ERROR nova.api.openstack.wsgi Jun 16 18:21:53.571273 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi [None req-59ea8f47-617d-42e5-9e23-b04b02b422eb admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:21:53.572382 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: INFO nova.api.openstack.requestlog [None req-59ea8f47-617d-42e5-9e23-b04b02b422eb admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.015792 Jun 16 18:21:53.572382 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: [pid: 103102|app: 0|req: 22/42] 10.222.0.30 () {60 vars in 1190 bytes} [Thu Jun 16 18:21:53 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jun 16 18:21:54.455868 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi [None req-8598e931-079b-4f02-9633-e8c7d98cd7cd admin admin] Calling method '>' {{(pid=103101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:21:54.456893 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: INFO nova.api.openstack.requestlog [None req-8598e931-079b-4f02-9633-e8c7d98cd7cd admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001508 Jun 16 18:21:54.457300 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: [pid: 103101|app: 0|req: 21/43] 10.222.0.30 () {56 vars in 1074 bytes} [Thu Jun 16 18:21:54 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:21:54.653568 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi [None req-188f6268-5946-4950-8c92-5f99e925e537 admin admin] Calling method '>' {{(pid=103102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:21:54.660080 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: INFO nova.api.openstack.wsgi [None req-188f6268-5946-4950-8c92-5f99e925e537 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jun 16 18:21:54.661580 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi [None req-188f6268-5946-4950-8c92-5f99e925e537 admin admin] Request method failure captured: Jun 16 18:21:54.661580 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jun 16 18:21:54.661580 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: Accept: application/json Jun 16 18:21:54.661580 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: Accept-Encoding: gzip, deflate Jun 16 18:21:54.661580 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: Connection: keep-alive Jun 16 18:21:54.661580 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: Content-Length: 0 Jun 16 18:21:54.661580 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: Host: 10.222.0.30 Jun 16 18:21:54.661580 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: Openstack-Api-Version: compute 2.90 Jun 16 18:21:54.661580 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: Openstack-System-Scope: None Jun 16 18:21:54.661580 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: User-Agent: python-novaclient Jun 16 18:21:54.661580 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: X-Auth-Token: gAAAAABiq3TCvXFhwkdHUrjuTLo_jAGSV-bpYt-fMmy1hyVrGxyFCPbMN5XBSji_wYQ3uyoELwNIMMcKimhhfd9y8mcLZvMoH5KEnRZUQ3j3leuKQkwT1v4qWi_gkBjZrMzBibY_nIYRFvxl0NZk1fWvM6on5nvteLux7u0cIZATQTE7PV8n5Ms Jun 16 18:21:54.661580 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: X-Domain-Id: None Jun 16 18:21:54.661580 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: X-Domain-Name: None Jun 16 18:21:54.661580 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: X-Identity-Status: Confirmed Jun 16 18:21:54.661580 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: X-Is-Admin-Project: True Jun 16 18:21:54.661580 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: X-Openstack-Nova-Api-Version: 2.90 Jun 16 18:21:54.661580 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: X-Project-Domain-Id: default Jun 16 18:21:54.661580 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: X-Project-Domain-Name: Default Jun 16 18:21:54.661580 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: X-Project-Id: 243115c739b84006986ba2e6345f2509 Jun 16 18:21:54.661580 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: X-Project-Name: admin Jun 16 18:21:54.661580 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: X-Role: reader,admin,member Jun 16 18:21:54.661580 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: X-Roles: reader,admin,member Jun 16 18:21:54.663209 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/243115c739b84006986ba2e6345f2509"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/243115c739b84006986ba2e6345f2509"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_243115c739b84006986ba2e6345f2509", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/243115c739b84006986ba2e6345f2509"}]}] Jun 16 18:21:54.663209 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: X-Tenant: admin Jun 16 18:21:54.663209 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: X-Tenant-Id: 243115c739b84006986ba2e6345f2509 Jun 16 18:21:54.663209 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: X-Tenant-Name: admin Jun 16 18:21:54.663209 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: X-User: admin Jun 16 18:21:54.663209 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: X-User-Domain-Id: default Jun 16 18:21:54.663209 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: X-User-Domain-Name: Default Jun 16 18:21:54.663209 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: X-User-Id: bd8fd8fbb8b9467bac357373688c6910 Jun 16 18:21:54.663209 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: X-User-Name: admin Jun 16 18:21:54.663209 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: method: > Jun 16 18:21:54.663209 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: exception: Flavor 84 could not be found. Jun 16 18:21:54.663209 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: action_args: {'id': '84'} Jun 16 18:21:54.663209 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: {{(pid=103102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:21:54.663209 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:21:54.664103 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 16 18:21:54.664103 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 16 18:21:54.664103 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 16 18:21:54.664103 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 16 18:21:54.664103 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 16 18:21:54.664103 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 16 18:21:54.664103 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 16 18:21:54.664103 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 16 18:21:54.664103 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 16 18:21:54.664103 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:21:54.664103 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 16 18:21:54.664103 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 16 18:21:54.664103 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jun 16 18:21:54.664103 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: ERROR nova.api.openstack.wsgi Jun 16 18:21:54.664103 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:21:54.664103 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: ERROR nova.api.openstack.wsgi Jun 16 18:21:54.664103 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:21:54.664103 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:21:54.664103 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:21:54.665747 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:21:54.665747 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:21:54.665747 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:21:54.665747 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:21:54.665747 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 16 18:21:54.665747 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:21:54.665747 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jun 16 18:21:54.665747 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: ERROR nova.api.openstack.wsgi Jun 16 18:21:54.665747 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:21:54.665747 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: ERROR nova.api.openstack.wsgi Jun 16 18:21:54.665747 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:21:54.665747 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:21:54.665747 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:21:54.665747 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:21:54.665747 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:21:54.665747 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jun 16 18:21:54.665747 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: ERROR nova.api.openstack.wsgi Jun 16 18:21:54.665747 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi [None req-188f6268-5946-4950-8c92-5f99e925e537 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:21:54.668069 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: INFO nova.api.openstack.requestlog [None req-188f6268-5946-4950-8c92-5f99e925e537 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.064277 Jun 16 18:21:54.668069 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: [pid: 103102|app: 0|req: 23/44] 10.222.0.30 () {60 vars in 1190 bytes} [Thu Jun 16 18:21:54 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 16 18:21:54.673706 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi [None req-97bf2b4a-21a8-412e-a29f-35b071beabc6 admin admin] Calling method '>' {{(pid=103101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:21:54.687492 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: INFO nova.api.openstack.requestlog [None req-97bf2b4a-21a8-412e-a29f-35b071beabc6 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018214 Jun 16 18:21:54.688034 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: [pid: 103101|app: 0|req: 22/45] 10.222.0.30 () {60 vars in 1210 bytes} [Thu Jun 16 18:21:54 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:21:54.698499 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi [None req-4ab37c5a-5237-4fb5-b1eb-101de1db9624 admin admin] Calling method '>' {{(pid=103102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:21:54.712473 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: INFO nova.api.openstack.requestlog [None req-4ab37c5a-5237-4fb5-b1eb-101de1db9624 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017482 Jun 16 18:21:54.713199 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: [pid: 103102|app: 0|req: 24/46] 10.222.0.30 () {60 vars in 1210 bytes} [Thu Jun 16 18:21:54 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:21:54.723196 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi [None req-25b4466d-d399-4b79-b644-80bf424a10da admin admin] Calling method '>' {{(pid=103101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:21:54.728556 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: INFO nova.api.openstack.wsgi [None req-25b4466d-d399-4b79-b644-80bf424a10da admin admin] HTTP exception thrown: Flavor 84 could not be found. Jun 16 18:21:54.730048 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi [None req-25b4466d-d399-4b79-b644-80bf424a10da admin admin] Request method failure captured: Jun 16 18:21:54.730048 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jun 16 18:21:54.730048 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: Accept: application/json Jun 16 18:21:54.730048 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: Accept-Encoding: gzip, deflate Jun 16 18:21:54.730048 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: Connection: keep-alive Jun 16 18:21:54.730048 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: Content-Length: 0 Jun 16 18:21:54.730048 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: Host: 10.222.0.30 Jun 16 18:21:54.730048 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: Openstack-Api-Version: compute 2.90 Jun 16 18:21:54.730048 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: Openstack-System-Scope: None Jun 16 18:21:54.730048 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: User-Agent: python-novaclient Jun 16 18:21:54.730048 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: X-Auth-Token: gAAAAABiq3TCvXFhwkdHUrjuTLo_jAGSV-bpYt-fMmy1hyVrGxyFCPbMN5XBSji_wYQ3uyoELwNIMMcKimhhfd9y8mcLZvMoH5KEnRZUQ3j3leuKQkwT1v4qWi_gkBjZrMzBibY_nIYRFvxl0NZk1fWvM6on5nvteLux7u0cIZATQTE7PV8n5Ms Jun 16 18:21:54.730048 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: X-Domain-Id: None Jun 16 18:21:54.730048 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: X-Domain-Name: None Jun 16 18:21:54.730048 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: X-Identity-Status: Confirmed Jun 16 18:21:54.730048 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: X-Is-Admin-Project: True Jun 16 18:21:54.730048 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: X-Openstack-Nova-Api-Version: 2.90 Jun 16 18:21:54.730048 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: X-Project-Domain-Id: default Jun 16 18:21:54.730048 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: X-Project-Domain-Name: Default Jun 16 18:21:54.730048 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: X-Project-Id: 243115c739b84006986ba2e6345f2509 Jun 16 18:21:54.730048 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: X-Project-Name: admin Jun 16 18:21:54.730048 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: X-Role: reader,admin,member Jun 16 18:21:54.730048 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: X-Roles: reader,admin,member Jun 16 18:21:54.731583 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/243115c739b84006986ba2e6345f2509"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/243115c739b84006986ba2e6345f2509"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_243115c739b84006986ba2e6345f2509", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/243115c739b84006986ba2e6345f2509"}]}] Jun 16 18:21:54.731583 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: X-Tenant: admin Jun 16 18:21:54.731583 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: X-Tenant-Id: 243115c739b84006986ba2e6345f2509 Jun 16 18:21:54.731583 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: X-Tenant-Name: admin Jun 16 18:21:54.731583 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: X-User: admin Jun 16 18:21:54.731583 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: X-User-Domain-Id: default Jun 16 18:21:54.731583 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: X-User-Domain-Name: Default Jun 16 18:21:54.731583 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: X-User-Id: bd8fd8fbb8b9467bac357373688c6910 Jun 16 18:21:54.731583 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: X-User-Name: admin Jun 16 18:21:54.731583 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: method: > Jun 16 18:21:54.731583 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: exception: Flavor 84 could not be found. Jun 16 18:21:54.731583 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: action_args: {'id': '84'} Jun 16 18:21:54.731583 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: {{(pid=103101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:21:54.731583 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:21:54.732628 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 16 18:21:54.732628 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 16 18:21:54.732628 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 16 18:21:54.732628 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 16 18:21:54.732628 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 16 18:21:54.732628 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 16 18:21:54.732628 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 16 18:21:54.732628 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 16 18:21:54.732628 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 16 18:21:54.732628 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:21:54.732628 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 16 18:21:54.732628 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 16 18:21:54.732628 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jun 16 18:21:54.732628 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: ERROR nova.api.openstack.wsgi Jun 16 18:21:54.732628 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:21:54.732628 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: ERROR nova.api.openstack.wsgi Jun 16 18:21:54.732628 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:21:54.732628 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:21:54.732628 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:21:54.734030 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:21:54.734030 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:21:54.734030 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:21:54.734030 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:21:54.734030 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 16 18:21:54.734030 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:21:54.734030 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jun 16 18:21:54.734030 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: ERROR nova.api.openstack.wsgi Jun 16 18:21:54.734030 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:21:54.734030 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: ERROR nova.api.openstack.wsgi Jun 16 18:21:54.734030 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:21:54.734030 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:21:54.734030 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:21:54.734030 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:21:54.734030 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:21:54.734030 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jun 16 18:21:54.734030 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: ERROR nova.api.openstack.wsgi Jun 16 18:21:54.734030 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi [None req-25b4466d-d399-4b79-b644-80bf424a10da admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103101) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:21:54.735151 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: INFO nova.api.openstack.requestlog [None req-25b4466d-d399-4b79-b644-80bf424a10da admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012508 Jun 16 18:21:54.735151 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: [pid: 103101|app: 0|req: 23/47] 10.222.0.30 () {60 vars in 1190 bytes} [Thu Jun 16 18:21:54 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 16 18:21:55.612883 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi [None req-4ab37c5a-5237-4fb5-b1eb-101de1db9624 admin admin] Calling method '>' {{(pid=103102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:21:55.613921 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: INFO nova.api.openstack.requestlog [None req-4ab37c5a-5237-4fb5-b1eb-101de1db9624 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001525 Jun 16 18:21:55.614313 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: [pid: 103102|app: 0|req: 25/48] 10.222.0.30 () {56 vars in 1074 bytes} [Thu Jun 16 18:21:55 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:21:55.812582 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi [None req-5aff47a2-6f25-408e-a7b7-0d112230b372 admin admin] Calling method '>' {{(pid=103101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:21:55.820512 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: INFO nova.api.openstack.wsgi [None req-5aff47a2-6f25-408e-a7b7-0d112230b372 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jun 16 18:21:55.822026 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi [None req-5aff47a2-6f25-408e-a7b7-0d112230b372 admin admin] Request method failure captured: Jun 16 18:21:55.822026 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jun 16 18:21:55.822026 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: Accept: application/json Jun 16 18:21:55.822026 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: Accept-Encoding: gzip, deflate Jun 16 18:21:55.822026 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: Connection: keep-alive Jun 16 18:21:55.822026 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: Content-Length: 0 Jun 16 18:21:55.822026 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: Host: 10.222.0.30 Jun 16 18:21:55.822026 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: Openstack-Api-Version: compute 2.90 Jun 16 18:21:55.822026 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: Openstack-System-Scope: None Jun 16 18:21:55.822026 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: User-Agent: python-novaclient Jun 16 18:21:55.822026 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: X-Auth-Token: gAAAAABiq3TDl75_o3_c8OzO8H-SqllPPMTCKTkwFXXtPMPh6HdA64F8xzbYCYlISxkx0jv5o5cKYcHn9P3YtdEdREZvnLYtRncc40tjBjLUw5F_AHgeCJkq3ixcJVMSq-bQhz0iw-JUOsRP0SatZ-YxSdoIo1OgrkQ9SLaA1RMijoBOrAELcxE Jun 16 18:21:55.822026 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: X-Domain-Id: None Jun 16 18:21:55.822026 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: X-Domain-Name: None Jun 16 18:21:55.822026 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: X-Identity-Status: Confirmed Jun 16 18:21:55.822026 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: X-Is-Admin-Project: True Jun 16 18:21:55.822026 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: X-Openstack-Nova-Api-Version: 2.90 Jun 16 18:21:55.822026 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: X-Project-Domain-Id: default Jun 16 18:21:55.822026 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: X-Project-Domain-Name: Default Jun 16 18:21:55.822026 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: X-Project-Id: 243115c739b84006986ba2e6345f2509 Jun 16 18:21:55.822026 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: X-Project-Name: admin Jun 16 18:21:55.822026 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: X-Role: reader,admin,member Jun 16 18:21:55.822026 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: X-Roles: reader,admin,member Jun 16 18:21:55.823544 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/243115c739b84006986ba2e6345f2509"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/243115c739b84006986ba2e6345f2509"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_243115c739b84006986ba2e6345f2509", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/243115c739b84006986ba2e6345f2509"}]}] Jun 16 18:21:55.823544 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: X-Tenant: admin Jun 16 18:21:55.823544 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: X-Tenant-Id: 243115c739b84006986ba2e6345f2509 Jun 16 18:21:55.823544 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: X-Tenant-Name: admin Jun 16 18:21:55.823544 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: X-User: admin Jun 16 18:21:55.823544 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: X-User-Domain-Id: default Jun 16 18:21:55.823544 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: X-User-Domain-Name: Default Jun 16 18:21:55.823544 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: X-User-Id: bd8fd8fbb8b9467bac357373688c6910 Jun 16 18:21:55.823544 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: X-User-Name: admin Jun 16 18:21:55.823544 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: method: > Jun 16 18:21:55.823544 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: exception: Flavor 451 could not be found. Jun 16 18:21:55.823544 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: action_args: {'id': '451'} Jun 16 18:21:55.823544 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: {{(pid=103101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:21:55.823544 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:21:55.824502 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 16 18:21:55.824502 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 16 18:21:55.824502 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 16 18:21:55.824502 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 16 18:21:55.824502 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 16 18:21:55.824502 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 16 18:21:55.824502 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 16 18:21:55.824502 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 16 18:21:55.824502 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 16 18:21:55.824502 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:21:55.824502 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 16 18:21:55.824502 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 16 18:21:55.824502 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jun 16 18:21:55.824502 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: ERROR nova.api.openstack.wsgi Jun 16 18:21:55.824502 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:21:55.824502 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: ERROR nova.api.openstack.wsgi Jun 16 18:21:55.824502 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:21:55.824502 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:21:55.824502 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:21:55.825904 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:21:55.825904 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:21:55.825904 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:21:55.825904 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:21:55.825904 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 16 18:21:55.825904 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:21:55.825904 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jun 16 18:21:55.825904 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: ERROR nova.api.openstack.wsgi Jun 16 18:21:55.825904 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:21:55.825904 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: ERROR nova.api.openstack.wsgi Jun 16 18:21:55.825904 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:21:55.825904 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:21:55.825904 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:21:55.825904 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:21:55.825904 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:21:55.825904 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jun 16 18:21:55.825904 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: ERROR nova.api.openstack.wsgi Jun 16 18:21:55.825904 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi [None req-5aff47a2-6f25-408e-a7b7-0d112230b372 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103101) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:21:55.827119 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: INFO nova.api.openstack.requestlog [None req-5aff47a2-6f25-408e-a7b7-0d112230b372 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.066849 Jun 16 18:21:55.827119 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: [pid: 103101|app: 0|req: 24/49] 10.222.0.30 () {60 vars in 1193 bytes} [Thu Jun 16 18:21:55 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 16 18:21:55.834206 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi [None req-ef0a913e-486c-4221-a7c2-4836f81af5b2 admin admin] Calling method '>' {{(pid=103102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:21:55.849616 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: INFO nova.api.openstack.requestlog [None req-ef0a913e-486c-4221-a7c2-4836f81af5b2 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019248 Jun 16 18:21:55.850170 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: [pid: 103102|app: 0|req: 26/50] 10.222.0.30 () {60 vars in 1210 bytes} [Thu Jun 16 18:21:55 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:21:55.859722 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi [None req-975acd2c-e5cc-4b62-95a8-5e1c2b0c96cd admin admin] Calling method '>' {{(pid=103101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:21:55.874910 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: INFO nova.api.openstack.requestlog [None req-975acd2c-e5cc-4b62-95a8-5e1c2b0c96cd admin admin] 10.222.0.30 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018656 Jun 16 18:21:55.875507 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: [pid: 103101|app: 0|req: 25/51] 10.222.0.30 () {60 vars in 1210 bytes} [Thu Jun 16 18:21:55 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:21:55.886133 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi [None req-aa8eed33-35de-4dcd-8f4a-bd10b38b92b3 admin admin] Calling method '>' {{(pid=103102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:21:55.892629 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: INFO nova.api.openstack.wsgi [None req-aa8eed33-35de-4dcd-8f4a-bd10b38b92b3 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jun 16 18:21:55.894116 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi [None req-aa8eed33-35de-4dcd-8f4a-bd10b38b92b3 admin admin] Request method failure captured: Jun 16 18:21:55.894116 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jun 16 18:21:55.894116 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: Accept: application/json Jun 16 18:21:55.894116 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: Accept-Encoding: gzip, deflate Jun 16 18:21:55.894116 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: Connection: keep-alive Jun 16 18:21:55.894116 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: Content-Length: 0 Jun 16 18:21:55.894116 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: Host: 10.222.0.30 Jun 16 18:21:55.894116 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: Openstack-Api-Version: compute 2.90 Jun 16 18:21:55.894116 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: Openstack-System-Scope: None Jun 16 18:21:55.894116 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: User-Agent: python-novaclient Jun 16 18:21:55.894116 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: X-Auth-Token: gAAAAABiq3TDl75_o3_c8OzO8H-SqllPPMTCKTkwFXXtPMPh6HdA64F8xzbYCYlISxkx0jv5o5cKYcHn9P3YtdEdREZvnLYtRncc40tjBjLUw5F_AHgeCJkq3ixcJVMSq-bQhz0iw-JUOsRP0SatZ-YxSdoIo1OgrkQ9SLaA1RMijoBOrAELcxE Jun 16 18:21:55.894116 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: X-Domain-Id: None Jun 16 18:21:55.894116 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: X-Domain-Name: None Jun 16 18:21:55.894116 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: X-Identity-Status: Confirmed Jun 16 18:21:55.894116 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: X-Is-Admin-Project: True Jun 16 18:21:55.894116 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: X-Openstack-Nova-Api-Version: 2.90 Jun 16 18:21:55.894116 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: X-Project-Domain-Id: default Jun 16 18:21:55.894116 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: X-Project-Domain-Name: Default Jun 16 18:21:55.894116 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: X-Project-Id: 243115c739b84006986ba2e6345f2509 Jun 16 18:21:55.894116 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: X-Project-Name: admin Jun 16 18:21:55.894116 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: X-Role: reader,admin,member Jun 16 18:21:55.894116 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: X-Roles: reader,admin,member Jun 16 18:21:55.895589 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/243115c739b84006986ba2e6345f2509"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/243115c739b84006986ba2e6345f2509"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_243115c739b84006986ba2e6345f2509", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/243115c739b84006986ba2e6345f2509"}]}] Jun 16 18:21:55.895589 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: X-Tenant: admin Jun 16 18:21:55.895589 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: X-Tenant-Id: 243115c739b84006986ba2e6345f2509 Jun 16 18:21:55.895589 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: X-Tenant-Name: admin Jun 16 18:21:55.895589 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: X-User: admin Jun 16 18:21:55.895589 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: X-User-Domain-Id: default Jun 16 18:21:55.895589 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: X-User-Domain-Name: Default Jun 16 18:21:55.895589 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: X-User-Id: bd8fd8fbb8b9467bac357373688c6910 Jun 16 18:21:55.895589 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: X-User-Name: admin Jun 16 18:21:55.895589 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: method: > Jun 16 18:21:55.895589 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: exception: Flavor 451 could not be found. Jun 16 18:21:55.895589 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: action_args: {'id': '451'} Jun 16 18:21:55.895589 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: {{(pid=103102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:21:55.895589 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:21:55.896707 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 16 18:21:55.896707 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 16 18:21:55.896707 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 16 18:21:55.896707 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 16 18:21:55.896707 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 16 18:21:55.896707 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 16 18:21:55.896707 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 16 18:21:55.896707 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 16 18:21:55.896707 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 16 18:21:55.896707 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:21:55.896707 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 16 18:21:55.896707 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 16 18:21:55.896707 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jun 16 18:21:55.896707 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: ERROR nova.api.openstack.wsgi Jun 16 18:21:55.896707 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:21:55.896707 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: ERROR nova.api.openstack.wsgi Jun 16 18:21:55.896707 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:21:55.896707 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:21:55.896707 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:21:55.898092 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:21:55.898092 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:21:55.898092 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:21:55.898092 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:21:55.898092 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 16 18:21:55.898092 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:21:55.898092 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jun 16 18:21:55.898092 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: ERROR nova.api.openstack.wsgi Jun 16 18:21:55.898092 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:21:55.898092 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: ERROR nova.api.openstack.wsgi Jun 16 18:21:55.898092 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:21:55.898092 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:21:55.898092 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:21:55.898092 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:21:55.898092 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:21:55.898092 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jun 16 18:21:55.898092 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: ERROR nova.api.openstack.wsgi Jun 16 18:21:55.898092 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi [None req-aa8eed33-35de-4dcd-8f4a-bd10b38b92b3 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103102) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:21:55.899234 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: INFO nova.api.openstack.requestlog [None req-aa8eed33-35de-4dcd-8f4a-bd10b38b92b3 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012980 Jun 16 18:21:55.899234 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: [pid: 103102|app: 0|req: 27/52] 10.222.0.30 () {60 vars in 1193 bytes} [Thu Jun 16 18:21:55 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jun 16 18:21:56.779237 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi [None req-975acd2c-e5cc-4b62-95a8-5e1c2b0c96cd admin admin] Calling method '>' {{(pid=103101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:21:56.780205 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: INFO nova.api.openstack.requestlog [None req-975acd2c-e5cc-4b62-95a8-5e1c2b0c96cd admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001441 Jun 16 18:21:56.780600 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: [pid: 103101|app: 0|req: 26/53] 10.222.0.30 () {56 vars in 1074 bytes} [Thu Jun 16 18:21:56 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:21:56.975078 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi [None req-e28ef574-394e-4ce7-9ee6-b07f007cb2a2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:21:56.992675 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: INFO nova.api.openstack.requestlog [None req-e28ef574-394e-4ce7-9ee6-b07f007cb2a2 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.071547 Jun 16 18:21:56.993219 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: [pid: 103102|app: 0|req: 28/54] 10.222.0.30 () {64 vars in 1235 bytes} [Thu Jun 16 18:21:56 2022] POST /compute/v2.1/flavors => generated 404 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 18:21:57.878639 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi [None req-975acd2c-e5cc-4b62-95a8-5e1c2b0c96cd admin admin] Calling method '>' {{(pid=103101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:21:57.879640 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: INFO nova.api.openstack.requestlog [None req-975acd2c-e5cc-4b62-95a8-5e1c2b0c96cd admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001429 Jun 16 18:21:57.880037 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: [pid: 103101|app: 0|req: 27/55] 10.222.0.30 () {56 vars in 1074 bytes} [Thu Jun 16 18:21:57 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:21:58.075026 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi [None req-c4e141a6-5fca-4755-b2cb-454bc0948fe1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:21:58.093579 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: INFO nova.api.openstack.requestlog [None req-c4e141a6-5fca-4755-b2cb-454bc0948fe1 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.072693 Jun 16 18:21:58.094129 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: [pid: 103102|app: 0|req: 29/56] 10.222.0.30 () {64 vars in 1235 bytes} [Thu Jun 16 18:21:58 2022] POST /compute/v2.1/flavors => generated 405 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 16 18:21:58.959688 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi [None req-975acd2c-e5cc-4b62-95a8-5e1c2b0c96cd admin admin] Calling method '>' {{(pid=103101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:21:58.960736 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: INFO nova.api.openstack.requestlog [None req-975acd2c-e5cc-4b62-95a8-5e1c2b0c96cd admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001466 Jun 16 18:21:58.961136 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: [pid: 103101|app: 0|req: 28/57] 10.222.0.30 () {56 vars in 1074 bytes} [Thu Jun 16 18:21:58 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:21:59.157105 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi [None req-0e772bc9-0077-4727-b532-5c3a0371bcee admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:21:59.175042 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: INFO nova.api.openstack.requestlog [None req-0e772bc9-0077-4727-b532-5c3a0371bcee admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.071820 Jun 16 18:21:59.175577 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: [pid: 103102|app: 0|req: 30/58] 10.222.0.30 () {64 vars in 1235 bytes} [Thu Jun 16 18:21:59 2022] POST /compute/v2.1/flavors => generated 407 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 18:22:00.072083 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi [None req-975acd2c-e5cc-4b62-95a8-5e1c2b0c96cd admin admin] Calling method '>' {{(pid=103101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:22:00.073095 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: INFO nova.api.openstack.requestlog [None req-975acd2c-e5cc-4b62-95a8-5e1c2b0c96cd admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001456 Jun 16 18:22:00.073497 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: [pid: 103101|app: 0|req: 29/59] 10.222.0.30 () {56 vars in 1074 bytes} [Thu Jun 16 18:22:00 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:22:00.265893 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi [None req-92f754b8-4ea4-44e7-aaae-24ca9330370e admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:22:00.284780 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: INFO nova.api.openstack.requestlog [None req-92f754b8-4ea4-44e7-aaae-24ca9330370e admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.071892 Jun 16 18:22:00.285241 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: [pid: 103102|app: 0|req: 31/60] 10.222.0.30 () {64 vars in 1235 bytes} [Thu Jun 16 18:22:00 2022] POST /compute/v2.1/flavors => generated 409 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 18:22:01.181044 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi [None req-975acd2c-e5cc-4b62-95a8-5e1c2b0c96cd admin admin] Calling method '>' {{(pid=103101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:22:01.182079 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: INFO nova.api.openstack.requestlog [None req-975acd2c-e5cc-4b62-95a8-5e1c2b0c96cd admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001450 Jun 16 18:22:01.182487 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: [pid: 103101|app: 0|req: 30/61] 10.222.0.30 () {56 vars in 1074 bytes} [Thu Jun 16 18:22:01 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:22:01.375087 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi [None req-57729137-028a-49aa-bd1b-0eb539008f65 admin admin] Calling method '>' {{(pid=103102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:22:01.395137 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: INFO nova.api.openstack.requestlog [None req-57729137-028a-49aa-bd1b-0eb539008f65 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.073819 Jun 16 18:22:01.395620 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: [pid: 103102|app: 0|req: 32/62] 10.222.0.30 () {60 vars in 1202 bytes} [Thu Jun 16 18:22:01 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:22:50.400079 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi [None req-975acd2c-e5cc-4b62-95a8-5e1c2b0c96cd admin admin] Calling method '>' {{(pid=103101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:22:50.401112 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: INFO nova.api.openstack.requestlog [None req-975acd2c-e5cc-4b62-95a8-5e1c2b0c96cd admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001500 Jun 16 18:22:50.401516 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: [pid: 103101|app: 0|req: 31/63] 10.222.0.30 () {54 vars in 930 bytes} [Thu Jun 16 18:22:50 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:22:50.412017 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG dbcounter [-] [103102] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=103102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:22:50.463269 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi [None req-0f025e5b-e860-44c4-905d-c9e7fde269d1 admin admin] Calling method '>' {{(pid=103102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:22:50.482529 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: INFO nova.api.openstack.requestlog [None req-0f025e5b-e860-44c4-905d-c9e7fde269d1 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.074903 Jun 16 18:22:50.483073 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: [pid: 103102|app: 0|req: 33/64] 10.222.0.30 () {60 vars in 1291 bytes} [Thu Jun 16 18:22:50 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:22:50.506981 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi [None req-88615661-4511-4af6-8bd3-a554aa1eb1a4 admin admin] Calling method '>' {{(pid=103101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:22:50.510440 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG dbcounter [-] [103101] Writing DB stats nova_api:SELECT=14 {{(pid=103101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:22:50.516029 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: INFO nova.api.openstack.requestlog [None req-88615661-4511-4af6-8bd3-a554aa1eb1a4 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012629 Jun 16 18:22:50.516625 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: [pid: 103101|app: 0|req: 32/65] 10.222.0.30 () {60 vars in 1282 bytes} [Thu Jun 16 18:22:50 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:22:50.528375 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi [None req-c509e43d-1a63-42b3-8db4-23f41577a2c1 admin admin] Calling method '>' {{(pid=103102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:22:50.536074 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: INFO nova.api.openstack.requestlog [None req-c509e43d-1a63-42b3-8db4-23f41577a2c1 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011302 Jun 16 18:22:50.536610 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: [pid: 103102|app: 0|req: 34/66] 10.222.0.30 () {60 vars in 1285 bytes} [Thu Jun 16 18:22:50 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:22:50.549318 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi [None req-2f01969e-7e86-4740-bda3-b59cfd46b40f admin admin] Calling method '>' {{(pid=103101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:22:50.556947 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: INFO nova.api.openstack.requestlog [None req-2f01969e-7e86-4740-bda3-b59cfd46b40f admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012220 Jun 16 18:22:50.557487 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: [pid: 103101|app: 0|req: 33/67] 10.222.0.30 () {60 vars in 1285 bytes} [Thu Jun 16 18:22:50 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:22:50.570347 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi [None req-e18e9927-5748-4dd3-bdbe-f66bbb9117c7 admin admin] Calling method '>' {{(pid=103102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:22:50.578164 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: INFO nova.api.openstack.requestlog [None req-e18e9927-5748-4dd3-bdbe-f66bbb9117c7 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011466 Jun 16 18:22:50.578695 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: [pid: 103102|app: 0|req: 35/68] 10.222.0.30 () {60 vars in 1282 bytes} [Thu Jun 16 18:22:50 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:26:10.424915 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi [None req-2f01969e-7e86-4740-bda3-b59cfd46b40f admin admin] Calling method '>' {{(pid=103101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:26:10.425984 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: INFO nova.api.openstack.requestlog [None req-2f01969e-7e86-4740-bda3-b59cfd46b40f admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001569 Jun 16 18:26:10.426420 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: [pid: 103101|app: 0|req: 34/69] 10.222.0.30 () {56 vars in 1074 bytes} [Thu Jun 16 18:26:10 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:26:10.591060 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG dbcounter [-] [103102] Writing DB stats nova_api:SELECT=6 {{(pid=103102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:26:10.727730 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi [None req-59c249a4-6a8c-4d41-bf4a-f0f3b27c1a2e admin admin] Calling method '>' {{(pid=103102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:26:10.729269 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 18:26:10.729269 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: warnings.warn(msg) Jun 16 18:26:10.730689 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG oslo_concurrency.lockutils [None req-59c249a4-6a8c-4d41-bf4a-f0f3b27c1a2e admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:26:10.731129 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG oslo_concurrency.lockutils [None req-59c249a4-6a8c-4d41-bf4a-f0f3b27c1a2e admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:26:10.731932 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG oslo_concurrency.lockutils [None req-59c249a4-6a8c-4d41-bf4a-f0f3b27c1a2e admin admin] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:26:10.732390 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG oslo_concurrency.lockutils [None req-59c249a4-6a8c-4d41-bf4a-f0f3b27c1a2e admin admin] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:26:10.771718 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: INFO nova.api.openstack.requestlog [None req-59c249a4-6a8c-4d41-bf4a-f0f3b27c1a2e admin admin] 10.222.0.30 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.181951 Jun 16 18:26:10.772370 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: [pid: 103102|app: 0|req: 36/70] 10.222.0.30 () {60 vars in 1193 bytes} [Thu Jun 16 18:26:10 2022] GET /compute/v2.1/os-services => generated 794 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 18:26:11.714330 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi [None req-2f01969e-7e86-4740-bda3-b59cfd46b40f admin admin] Calling method '>' {{(pid=103101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:26:11.715353 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: INFO nova.api.openstack.requestlog [None req-2f01969e-7e86-4740-bda3-b59cfd46b40f admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001474 Jun 16 18:26:11.715774 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: [pid: 103101|app: 0|req: 35/71] 10.222.0.30 () {56 vars in 1074 bytes} [Thu Jun 16 18:26:11 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:26:11.923394 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi [None req-5b7b3359-8283-4f91-879c-7ceac2286844 admin admin] Calling method '>' {{(pid=103102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:26:11.924571 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 18:26:11.924571 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: warnings.warn(msg) Jun 16 18:26:11.925812 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG oslo_concurrency.lockutils [None req-5b7b3359-8283-4f91-879c-7ceac2286844 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:26:11.926255 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG oslo_concurrency.lockutils [None req-5b7b3359-8283-4f91-879c-7ceac2286844 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:26:11.927080 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG oslo_concurrency.lockutils [None req-5b7b3359-8283-4f91-879c-7ceac2286844 admin admin] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:26:11.927578 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG oslo_concurrency.lockutils [None req-5b7b3359-8283-4f91-879c-7ceac2286844 admin admin] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:26:11.948423 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: INFO nova.api.openstack.requestlog [None req-5b7b3359-8283-4f91-879c-7ceac2286844 admin admin] 10.222.0.30 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.084704 Jun 16 18:26:11.949024 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: [pid: 103102|app: 0|req: 37/72] 10.222.0.30 () {60 vars in 1193 bytes} [Thu Jun 16 18:26:11 2022] GET /compute/v2.1/os-services => generated 794 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 18:26:23.298652 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi [None req-2f01969e-7e86-4740-bda3-b59cfd46b40f admin admin] Calling method '>' {{(pid=103101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:26:23.299690 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: INFO nova.api.openstack.requestlog [None req-2f01969e-7e86-4740-bda3-b59cfd46b40f admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001921 Jun 16 18:26:23.300128 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: [pid: 103101|app: 0|req: 36/73] 10.222.0.30 () {56 vars in 1074 bytes} [Thu Jun 16 18:26:23 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:26:23.445801 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG dbcounter [-] [103102] Writing DB stats nova_cell0:SELECT=4 {{(pid=103102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:26:23.446531 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG dbcounter [-] [103102] Writing DB stats nova_cell1:SELECT=4 {{(pid=103102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:26:23.447296 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG dbcounter [-] [103102] Writing DB stats nova_api:SELECT=8 {{(pid=103102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:26:23.501213 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi [None req-d30ea775-0e45-4124-a93b-e83434b5f055 admin admin] Calling method '>' {{(pid=103102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:26:23.502936 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 18:26:23.502936 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: warnings.warn(msg) Jun 16 18:26:23.505176 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG oslo_concurrency.lockutils [None req-d30ea775-0e45-4124-a93b-e83434b5f055 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:26:23.505964 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG oslo_concurrency.lockutils [None req-d30ea775-0e45-4124-a93b-e83434b5f055 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:26:23.507307 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG oslo_concurrency.lockutils [None req-d30ea775-0e45-4124-a93b-e83434b5f055 admin admin] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:26:23.507752 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG oslo_concurrency.lockutils [None req-d30ea775-0e45-4124-a93b-e83434b5f055 admin admin] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:26:23.534251 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: INFO nova.api.openstack.requestlog [None req-d30ea775-0e45-4124-a93b-e83434b5f055 admin admin] 10.222.0.30 "GET /compute/v2.1/os-services" status: 200 len: 1038 microversion: 2.90 time: 0.092763 Jun 16 18:26:23.534859 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: [pid: 103102|app: 0|req: 38/74] 10.222.0.30 () {60 vars in 1193 bytes} [Thu Jun 16 18:26:23 2022] GET /compute/v2.1/os-services => generated 1038 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:26:24.449261 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: DEBUG nova.api.openstack.wsgi [None req-2f01969e-7e86-4740-bda3-b59cfd46b40f admin admin] Calling method '>' {{(pid=103101) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:26:24.450286 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: INFO nova.api.openstack.requestlog [None req-2f01969e-7e86-4740-bda3-b59cfd46b40f admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001445 Jun 16 18:26:24.450688 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: [pid: 103101|app: 0|req: 37/75] 10.222.0.30 () {56 vars in 1074 bytes} [Thu Jun 16 18:26:24 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:26:24.647755 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG nova.api.openstack.wsgi [None req-69ef6b9d-61f4-47e4-a032-d140aea7f155 admin admin] Calling method '>' {{(pid=103102) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:26:24.648915 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 18:26:24.648915 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: warnings.warn(msg) Jun 16 18:26:24.650096 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG oslo_concurrency.lockutils [None req-69ef6b9d-61f4-47e4-a032-d140aea7f155 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:26:24.650525 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG oslo_concurrency.lockutils [None req-69ef6b9d-61f4-47e4-a032-d140aea7f155 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:26:24.651307 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG oslo_concurrency.lockutils [None req-69ef6b9d-61f4-47e4-a032-d140aea7f155 admin admin] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:26:24.651731 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: DEBUG oslo_concurrency.lockutils [None req-69ef6b9d-61f4-47e4-a032-d140aea7f155 admin admin] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103102) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:26:24.674101 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: INFO nova.api.openstack.requestlog [None req-69ef6b9d-61f4-47e4-a032-d140aea7f155 admin admin] 10.222.0.30 "GET /compute/v2.1/os-services" status: 200 len: 1038 microversion: 2.90 time: 0.080459 Jun 16 18:26:24.674666 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: [pid: 103102|app: 0|req: 39/76] 10.222.0.30 () {60 vars in 1193 bytes} [Thu Jun 16 18:26:24 2022] GET /compute/v2.1/os-services => generated 1038 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 18:27:23.858661 dv-cinder-813229-10-iscsi devstack@n-api.service[103100]: Thu Jun 16 18:27:23 2022 - graceful shutdown triggered... Jun 16 18:27:23.858998 dv-cinder-813229-10-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jun 16 18:27:23.859865 dv-cinder-813229-10-iscsi devstack@n-api.service[103102]: Gracefully killing worker 2 (pid: 103102)... Jun 16 18:27:23.860434 dv-cinder-813229-10-iscsi devstack@n-api.service[103101]: Gracefully killing worker 1 (pid: 103101)... Jun 16 18:27:24.859751 dv-cinder-813229-10-iscsi devstack@n-api.service[103100]: worker 1 buried after 1 seconds Jun 16 18:27:24.859751 dv-cinder-813229-10-iscsi devstack@n-api.service[103100]: worker 2 buried after 1 seconds Jun 16 18:27:24.859751 dv-cinder-813229-10-iscsi devstack@n-api.service[103100]: goodbye to uWSGI. Jun 16 18:27:24.861454 dv-cinder-813229-10-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jun 16 18:27:24.862265 dv-cinder-813229-10-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jun 16 18:27:24.865962 dv-cinder-813229-10-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jun 16 18:27:24.880435 dv-cinder-813229-10-iscsi devstack@n-api.service[117656]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jun 16 18:27:24.883707 dv-cinder-813229-10-iscsi devstack@n-api.service[117656]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Jun 16 18:27:24 2022] *** Jun 16 18:27:24.883707 dv-cinder-813229-10-iscsi devstack@n-api.service[117656]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 16 18:27:24.883707 dv-cinder-813229-10-iscsi devstack@n-api.service[117656]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 16 18:27:24.883707 dv-cinder-813229-10-iscsi devstack@n-api.service[117656]: nodename: dv-cinder-813229-10-iscsi Jun 16 18:27:24.883707 dv-cinder-813229-10-iscsi devstack@n-api.service[117656]: machine: x86_64 Jun 16 18:27:24.883707 dv-cinder-813229-10-iscsi devstack@n-api.service[117656]: clock source: unix Jun 16 18:27:24.883707 dv-cinder-813229-10-iscsi devstack@n-api.service[117656]: pcre jit disabled Jun 16 18:27:24.883707 dv-cinder-813229-10-iscsi devstack@n-api.service[117656]: detected number of CPU cores: 4 Jun 16 18:27:24.883707 dv-cinder-813229-10-iscsi devstack@n-api.service[117656]: current working directory: / Jun 16 18:27:24.883707 dv-cinder-813229-10-iscsi devstack@n-api.service[117656]: detected binary path: /usr/bin/uwsgi-core Jun 16 18:27:24.883707 dv-cinder-813229-10-iscsi devstack@n-api.service[117656]: your processes number limit is 47680 Jun 16 18:27:24.883707 dv-cinder-813229-10-iscsi devstack@n-api.service[117656]: your memory page size is 4096 bytes Jun 16 18:27:24.883707 dv-cinder-813229-10-iscsi devstack@n-api.service[117656]: detected max file descriptor number: 2048 Jun 16 18:27:24.883707 dv-cinder-813229-10-iscsi devstack@n-api.service[117656]: lock engine: pthread robust mutexes Jun 16 18:27:24.885373 dv-cinder-813229-10-iscsi devstack@n-api.service[117656]: thunder lock: enabled Jun 16 18:27:24.885373 dv-cinder-813229-10-iscsi devstack@n-api.service[117656]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jun 16 18:27:24.885373 dv-cinder-813229-10-iscsi devstack@n-api.service[117656]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 16 18:27:24.932901 dv-cinder-813229-10-iscsi devstack@n-api.service[117656]: Python main interpreter initialized at 0x55cd680699c0 Jun 16 18:27:24.932901 dv-cinder-813229-10-iscsi devstack@n-api.service[117656]: python threads support enabled Jun 16 18:27:24.932901 dv-cinder-813229-10-iscsi devstack@n-api.service[117656]: your server socket listen backlog is limited to 100 connections Jun 16 18:27:24.932901 dv-cinder-813229-10-iscsi devstack@n-api.service[117656]: your mercy for graceful operations on workers is 90 seconds Jun 16 18:27:24.933551 dv-cinder-813229-10-iscsi devstack@n-api.service[117656]: mapped 403077 bytes (393 KB) for 2 cores Jun 16 18:27:24.933551 dv-cinder-813229-10-iscsi devstack@n-api.service[117656]: *** Operational MODE: preforking *** Jun 16 18:27:24.933823 dv-cinder-813229-10-iscsi devstack@n-api.service[117656]: *** uWSGI is running in multiple interpreter mode *** Jun 16 18:27:24.933823 dv-cinder-813229-10-iscsi devstack@n-api.service[117656]: spawned uWSGI master process (pid: 117656) Jun 16 18:27:24.933984 dv-cinder-813229-10-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jun 16 18:27:24.934575 dv-cinder-813229-10-iscsi devstack@n-api.service[117656]: spawned uWSGI worker 1 (pid: 117670, cores: 1) Jun 16 18:27:24.935477 dv-cinder-813229-10-iscsi devstack@n-api.service[117656]: spawned uWSGI worker 2 (pid: 117671, cores: 1) Jun 16 18:27:24.940200 dv-cinder-813229-10-iscsi devstack@n-api.service[117656]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 16 18:27:25.730044 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 16 18:27:25.734701 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 16 18:27:27.291682 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 16 18:27:27.291682 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: from cryptography.utils import int_from_bytes Jun 16 18:27:27.292642 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 16 18:27:27.292642 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: from cryptography.utils import int_from_bytes Jun 16 18:27:27.539149 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 16 18:27:27.539149 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: from cryptography.utils import int_from_bytes Jun 16 18:27:27.539898 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 16 18:27:27.539898 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: from cryptography.utils import int_from_bytes Jun 16 18:27:30.028358 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 16 18:27:30.029922 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 16 18:27:30.030400 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 16 18:27:30.030604 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 16 18:27:30.030926 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 16 18:27:30.031208 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:27:30.031542 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:27:30.031872 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:27:30.032222 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:27:30.032561 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:27:30.032879 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:27:30.033215 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:27:30.033546 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:27:30.033912 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:27:30.034181 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:27:30.034423 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:27:30.034759 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-813229-10-iscsi {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:27:30.035088 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:27:30.035402 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:27:30.035722 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:27:30.036095 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:27:30.036375 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:27:30.036696 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:27:30.037006 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:27:30.037511 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:27:30.039157 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:27:30.039564 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:27:30.039957 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:27:30.040344 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:27:30.040728 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:27:30.040728 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:27:30.041931 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:27:30.041931 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:27:30.041931 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:27:30.042999 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:27:30.042999 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-813229-10-iscsi {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:27:30.042999 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:27:30.044616 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:27:30.044616 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:27:30.045329 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:27:30.045612 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:27:30.045942 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:27:30.046294 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:27:30.047010 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:27:30.047010 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:27:30.047540 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:27:30.047540 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:27:30.048012 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:27:30.048328 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:27:30.048686 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:27:30.048930 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:27:30.049186 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:27:30.049432 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:27:30.049682 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:27:30.051026 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:27:30.051026 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:27:30.051026 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:27:30.051026 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:27:30.051992 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:27:30.051992 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:27:30.051992 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:27:30.051992 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:27:30.052970 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:27:30.052970 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:27:30.052970 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:27:30.053640 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:27:30.053640 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:27:30.054092 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:27:30.054092 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:27:30.054552 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:27:30.054778 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:27:30.055012 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:27:30.055309 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:27:30.055619 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:27:30.055952 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:27:30.056290 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:27:30.056614 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:27:30.058078 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.30 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:27:30.058078 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.30 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:27:30.058078 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:27:30.058078 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:27:30.059006 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:27:30.059006 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:27:30.059006 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:27:30.061445 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:27:30.061445 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:27:30.061445 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:27:30.061445 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:27:30.062389 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:27:30.062389 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:27:30.062389 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:27:30.063119 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:27:30.063119 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:27:30.063119 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:27:30.063802 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:27:30.063802 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:27:30.064306 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:27:30.064306 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:27:30.064761 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:27:30.064999 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:27:30.065221 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:27:30.065449 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:27:30.065814 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:27:30.066072 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:27:30.066355 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:27:30.066663 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:27:30.067251 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:27:30.067251 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:27:30.067708 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:27:30.067942 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:27:30.068407 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:27:30.068671 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:27:30.068901 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:27:30.069134 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:27:30.069416 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:27:30.069726 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:27:30.070034 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:27:30.070461 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:27:30.071065 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:27:30.071065 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:27:30.072226 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:27:30.072226 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:27:30.072226 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:27:30.072226 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:27:30.073108 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:27:30.073108 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:27:30.073108 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:27:30.073787 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:27:30.073787 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:27:30.074232 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:27:30.074232 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:27:30.074686 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:27:30.074931 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:27:30.075755 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:27:30.075993 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:27:30.076331 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:27:30.076836 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:27:30.077249 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:27:30.077671 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:27:30.077914 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:27:30.078163 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:27:30.078581 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:27:30.078841 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.079155 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.079505 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.079825 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.080191 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.080629 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.080906 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.081483 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.081483 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.082597 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.082597 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.082597 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.083275 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.083275 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.083275 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.083928 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.083928 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.084439 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.084659 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.084892 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.085137 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.085480 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.085814 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.086130 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.086477 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.086824 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.087144 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.087470 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.087899 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.088181 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.088478 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.088899 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.089131 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.089368 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.089672 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.089992 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.090306 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.092739 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.092739 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.092739 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.092739 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.093707 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.093707 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.093707 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.094446 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.094446 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.095213 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.095213 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.095213 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.095867 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.095867 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.097408 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.097771 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.098210 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.098455 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.098772 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.099177 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.099420 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.099741 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.100089 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.100437 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.100761 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.101080 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.101461 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.102038 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.102038 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.103239 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.103239 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.103239 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.103239 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.104197 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.104197 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.104197 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.104936 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.104936 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.105375 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.105375 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.105813 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.106041 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.106357 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.106702 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.107325 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.107325 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.107787 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.108026 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.108496 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.108805 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.109078 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.109475 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.109699 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.109944 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.110203 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.110512 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.110823 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.111129 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.111437 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.111743 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.112413 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.112413 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.113546 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.113546 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.113546 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.114263 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.114263 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.114735 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.115025 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.115352 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.115686 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.116003 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.116378 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.116696 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.117013 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.117427 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.117670 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.117948 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.118262 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.118651 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.118882 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.119205 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.119620 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.119871 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.120199 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.120447 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.120799 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.121261 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.121564 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.121853 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.123997 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.123997 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.123997 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.123997 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.123997 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.123997 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.123997 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.125669 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.125669 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.125669 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.125669 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.125669 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.126806 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.126806 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.126806 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.126806 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.127892 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.127892 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.127892 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.128627 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.128627 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.129200 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.129200 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.129698 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.129698 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.130374 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.130374 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.130933 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.130933 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.131390 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.131390 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.131845 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.132147 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.132395 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.132683 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.132933 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.133378 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.134454 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.134454 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.134454 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.134454 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.135390 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.135390 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.135390 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.136275 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.136275 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.136275 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.137006 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.137006 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.138489 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.138489 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.138489 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.139321 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.139321 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.139321 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.140025 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.140025 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.140666 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.140666 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.141136 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.141136 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.141574 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.141819 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.142050 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.142286 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.142557 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.142867 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.143177 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.143592 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.144706 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.144706 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.145155 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.145155 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.145634 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.145857 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.146092 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.146384 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.146867 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.147103 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.147361 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.147628 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.147937 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.148263 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.148632 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.148876 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.149167 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.149554 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.149773 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.150065 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.150541 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.150774 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.151023 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.151277 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.151591 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.151895 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.152280 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.152645 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.152892 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.153907 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.154462 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.154462 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.155421 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.155421 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.155421 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.156171 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.156171 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.156614 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.156614 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.157079 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.157311 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.157549 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.157785 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.158250 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.158584 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.158969 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.158969 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.159492 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.159863 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.159863 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.160384 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.160650 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.161042 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.161269 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.161523 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.161751 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.162331 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.162599 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.162853 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.163095 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.163337 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.163575 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.163843 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.164735 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.164735 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.164735 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.165999 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.165999 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.165999 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.165999 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.167159 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.167159 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.167159 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.167971 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.167971 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.167971 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.168663 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.168663 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.169281 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.169281 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.170132 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.170132 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.170132 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.170796 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.170796 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.171461 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.171461 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.171931 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.171931 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.172456 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.172694 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.172954 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.173225 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.173459 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.173889 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.174135 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.174422 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.175166 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.175166 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.176408 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.176408 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.176408 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.176408 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.177357 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.177357 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.177357 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.178866 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.178866 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.178866 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.178866 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.178866 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.180338 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.180338 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.180338 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.180338 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.180338 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.181662 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.181662 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.181662 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.181662 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.182585 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.182585 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.182585 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.183259 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.183259 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.183259 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.183976 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.183976 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.186550 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.186550 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.186550 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.186550 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.186550 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.186550 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.186550 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.186550 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.188495 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.188495 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.188495 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.188495 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.188495 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.188495 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.191217 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.191217 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.191217 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.191217 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.191217 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.191217 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.191217 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.191217 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.193354 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.193354 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.193354 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.193354 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.193354 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.194530 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.194530 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.195045 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.195487 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.196813 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.196813 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.196813 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.197559 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.197811 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.198067 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.198511 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.198997 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.199285 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.201217 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.201217 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.201846 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.201846 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.202474 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.202707 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.203163 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.203502 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.203825 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.204223 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.204549 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.204880 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.205214 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.205662 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.206930 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.206930 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.206930 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.206930 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.207922 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.207922 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.207922 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.208659 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.208659 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.209129 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.209129 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.209628 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.209861 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.210099 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.210342 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.210655 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.210980 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.211278 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.211803 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.212076 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.212516 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.212761 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.213001 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.213443 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.213887 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.214167 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.214540 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.214785 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.215031 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.215307 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.216232 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.216566 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.216901 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.217218 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.217558 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.217891 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.218212 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.218533 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.218861 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.219171 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.219484 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.219799 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.220282 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.220509 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.220756 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.221113 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.221427 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.221766 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.222033 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.222359 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.222665 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.222989 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.223301 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.223607 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.223915 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.224250 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.224599 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.224906 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.225242 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.225567 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.225892 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.226230 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.226542 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.226868 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.227188 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.227503 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.227818 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.228163 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.228485 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.228804 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.229119 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.229432 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.229749 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.230063 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.230386 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.230969 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.231337 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.231658 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.231976 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.232342 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.232662 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.232980 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.233299 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.233615 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.233931 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.234246 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.234581 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.234908 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.235241 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.235598 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.235922 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.236270 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.236583 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.236927 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.237277 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.237600 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.237918 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.238237 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.238560 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.238883 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.239193 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.239561 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.240121 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.240451 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.240774 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.241094 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.241412 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.241730 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.242070 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.242412 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.242740 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.243057 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.243370 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.243687 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.244296 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.244624 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.244966 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.245300 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.245631 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.245968 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.246283 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.246608 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.247510 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.247827 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.248182 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.248501 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.248810 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.249143 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.249458 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.249769 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.250095 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.250411 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.251229 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.251604 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.251930 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.252293 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.252629 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.252958 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.253268 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.253603 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.253936 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.254235 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.254553 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.254925 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.255235 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.255547 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.255867 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.256220 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.256535 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.256853 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.257165 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.257499 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.257809 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.258118 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.258430 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.258747 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.259055 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.259365 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.259676 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.259982 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.260364 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.260675 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.260992 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.261303 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.261618 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.261925 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.262241 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.263160 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.263501 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.263815 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.264156 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.264480 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.264796 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.265123 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.265442 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.265756 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.266112 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.266439 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.267026 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.267363 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.267688 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.268031 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.268425 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.268736 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.269046 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.269355 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.269686 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.270003 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.270317 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.270631 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.270946 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.271259 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.271572 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.271884 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.272227 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.272542 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.272853 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.273167 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.273480 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.273794 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.274115 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.274467 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.274790 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.275110 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.275429 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.275746 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.276077 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.276404 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.276718 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.277031 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.277349 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.277681 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.278030 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.278341 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.278858 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.279228 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.279635 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.280018 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.280362 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.280691 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.281022 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.281369 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.281695 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.282011 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.282346 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.282689 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.283022 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.283350 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.283661 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.283969 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.284307 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.284624 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.284947 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.285258 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.285562 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.285870 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.286188 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.286493 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.286800 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.287105 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.287410 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.287722 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.288026 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.288379 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.288681 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.288989 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.289295 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.289600 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.289913 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.290218 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.290524 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.290829 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.291391 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.291695 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.292100 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.292721 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.292721 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.293078 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.293359 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.293715 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.294052 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.294352 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.294773 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.295106 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.295424 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.295765 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.296105 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.296430 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.296744 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.297058 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.297373 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.297686 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.298018 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.298346 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.298763 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.299097 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.299416 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.299741 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.300100 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.300401 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.300740 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.301051 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.301367 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.301689 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.301996 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.302307 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.302626 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.302945 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.303277 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.303604 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.303916 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.304272 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.304602 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.304957 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.305271 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.305619 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.305951 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.306274 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.306591 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.306897 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.307142 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117671) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 16 18:27:30.373038 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO dbcounter [None req-1f017603-6fd3-472f-b1b8-d5af5a7eefff None None] Registered counter for database nova_api Jun 16 18:27:30.395610 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_db.sqlalchemy.engines [None req-1f017603-6fd3-472f-b1b8-d5af5a7eefff None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117671) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 18:27:30.403274 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG dbcounter [-] [117671] Writer thread running {{(pid=117671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 18:27:30.467373 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.context [None req-1f017603-6fd3-472f-b1b8-d5af5a7eefff None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),aeb18649-0c63-4d1d-a910-334eb7a21817(cell1) {{(pid=117671) load_cells /opt/stack/nova/nova/context.py:464}} Jun 16 18:27:30.471698 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-1f017603-6fd3-472f-b1b8-d5af5a7eefff None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:27:30.473387 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-1f017603-6fd3-472f-b1b8-d5af5a7eefff None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:27:30.474256 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-1f017603-6fd3-472f-b1b8-d5af5a7eefff None None] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:27:30.476364 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-1f017603-6fd3-472f-b1b8-d5af5a7eefff None None] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:27:30.479088 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO dbcounter [None req-1f017603-6fd3-472f-b1b8-d5af5a7eefff None None] Registered counter for database nova_cell0 Jun 16 18:27:30.484031 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO dbcounter [None req-1f017603-6fd3-472f-b1b8-d5af5a7eefff None None] Registered counter for database nova_cell1 Jun 16 18:27:30.493750 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_db.sqlalchemy.engines [None req-1f017603-6fd3-472f-b1b8-d5af5a7eefff None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117671) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 18:27:30.494859 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_db.sqlalchemy.engines [None req-1f017603-6fd3-472f-b1b8-d5af5a7eefff None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117671) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 18:27:30.505269 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG dbcounter [-] [117671] Writer thread running {{(pid=117671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 18:27:30.510088 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG dbcounter [-] [117671] Writer thread running {{(pid=117671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 18:27:30.681255 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO dbcounter [None req-1f017603-6fd3-472f-b1b8-d5af5a7eefff None None] Registered counter for database nova_cell0 Jun 16 18:27:30.691903 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_db.sqlalchemy.engines [None req-1f017603-6fd3-472f-b1b8-d5af5a7eefff None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117671) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 18:27:30.697809 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG dbcounter [-] [117671] Writer thread running {{(pid=117671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 18:27:30.702777 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 16 18:27:30.703584 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 16 18:27:30.703584 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 16 18:27:30.703928 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 16 18:27:30.704216 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 16 18:27:30.704616 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:27:30.704943 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:27:30.705264 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:27:30.705583 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:27:30.705914 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:27:30.706227 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:27:30.706557 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:27:30.706878 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:27:30.707801 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:27:30.707801 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:27:30.708376 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:27:30.708549 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-813229-10-iscsi {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:27:30.708722 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:27:30.709032 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:27:30.709344 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:27:30.709665 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:27:30.709969 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:27:30.710292 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:27:30.710597 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:27:30.711104 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:27:30.711413 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:27:30.711728 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:27:30.712040 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:27:30.712613 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:27:30.712931 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:27:30.713241 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:27:30.713563 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:27:30.713873 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:27:30.714203 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:27:30.714489 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:27:30.714903 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-813229-10-iscsi {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:27:30.715224 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:27:30.715675 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:27:30.716538 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:27:30.717239 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:27:30.717590 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:27:30.717998 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:27:30.718279 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:27:30.718584 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:27:30.719027 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:27:30.719348 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:27:30.719713 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:27:30.727537 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:27:30.727537 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:27:30.727537 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:27:30.727537 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:27:30.727537 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:27:30.727537 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:27:30.727537 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:27:30.727537 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:27:30.728699 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:27:30.728699 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:27:30.728699 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:27:30.728699 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:27:30.728699 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:27:30.728699 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:27:30.728699 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:27:30.729564 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:27:30.729564 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:27:30.729564 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:27:30.729564 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:27:30.729564 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:27:30.729564 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:27:30.729564 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:27:30.729564 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:27:30.730514 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:27:30.730514 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:27:30.730514 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:27:30.730514 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:27:30.730514 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:27:30.730514 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:27:30.730514 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:27:30.730514 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.30 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:27:30.733398 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.30 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:27:30.733398 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:27:30.733398 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:27:30.733398 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:27:30.733398 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:27:30.733398 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:27:30.733398 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:27:30.733398 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:27:30.734885 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:27:30.734885 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:27:30.734885 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:27:30.734885 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:27:30.735667 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:27:30.735667 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:27:30.736022 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:27:30.737410 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:27:30.737410 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:27:30.737410 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:27:30.737410 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:27:30.738156 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:27:30.738156 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:27:30.738916 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:27:30.739304 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:27:30.739719 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:27:30.740513 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:27:30.741266 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:27:30.741694 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:27:30.742218 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:27:30.742656 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:27:30.743190 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:27:30.743639 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:27:30.743980 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:27:30.744352 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:27:30.744675 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:27:30.744993 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:27:30.745306 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:27:30.745636 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:27:30.745949 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:27:30.746260 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:27:30.749322 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:27:30.749322 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:27:30.749322 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:27:30.749322 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:27:30.749322 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:27:30.749322 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:27:30.749322 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:27:30.750769 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:27:30.750769 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:27:30.750769 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:27:30.750769 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:27:30.751600 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:27:30.751600 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:27:30.751600 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:27:30.752192 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:27:30.752192 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:27:30.752728 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:27:30.752728 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:27:30.753117 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:27:30.753325 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:27:30.753531 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:27:30.753830 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:27:30.754139 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:27:30.754448 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:27:30.754767 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:27:30.755110 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.755442 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.755788 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.756191 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.756533 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.757113 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.757327 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.757513 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.757867 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.758104 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.758407 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.758845 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.759738 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.759738 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.759738 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.760480 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.760480 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.760899 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.760899 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.761324 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.761540 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.761832 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.762154 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.763118 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.764270 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.764270 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.765585 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.765585 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.765585 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.765585 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.766332 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.766332 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.766706 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.766706 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.767100 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.767622 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.767622 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.768208 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.768208 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.768584 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.768834 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.769240 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.769915 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.770113 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.770531 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.771849 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.772203 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.772532 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.772855 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.773173 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.773603 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.773826 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.774217 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.774457 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.774869 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.775209 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.775521 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.775863 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.776213 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.776529 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.776848 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.777163 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.777758 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.778743 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.780544 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.780544 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.780544 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.781371 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.781593 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.782179 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.782761 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.783340 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.783881 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.784471 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.785178 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.785452 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.785788 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.786136 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.786463 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.786797 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.787147 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.787491 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.788197 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.788197 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.788606 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.788832 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.789190 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.789629 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.790531 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.790531 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.790531 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.791603 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.791603 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.792017 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.792017 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.792466 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.792668 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.792908 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.793247 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.793536 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.794454 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.795569 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.795569 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.795569 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.796164 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.796377 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.796574 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.796866 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.797204 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.797521 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.797836 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.798467 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.798467 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.798942 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.799191 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.799589 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.799839 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.800145 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.801031 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.801031 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.801466 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.801908 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.802172 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.804568 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.805202 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.805780 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.806357 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.806913 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.807469 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.808030 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.808657 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.809184 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.810384 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.811290 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.811564 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.812079 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.814069 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.814672 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.816397 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.817004 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.817556 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.818119 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.818861 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.819301 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.819855 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.820432 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.821387 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.821660 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.822287 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.822828 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.823209 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.823757 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.824334 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.824916 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.825572 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.826073 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.826504 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.827058 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.827608 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.828232 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.829075 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.829335 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.829895 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.830603 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.831089 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.831839 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.832157 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.832693 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.833273 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.833820 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.834361 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.834909 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.835451 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.836110 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.836782 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.837371 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.837926 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.838485 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.839080 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.839582 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.840174 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.840870 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.842454 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.842454 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.842454 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.843353 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.844652 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.844652 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.844652 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.846567 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.847139 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.847691 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.848274 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.848830 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.849467 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.849964 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.850961 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.851518 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.852445 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.852723 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.853241 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.853735 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.854311 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.854881 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.855712 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.856807 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.858419 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.858419 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.858919 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.859172 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.859589 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.860133 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.860667 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.861196 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.861725 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.862631 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.862885 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.863484 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.865672 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.865672 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.866228 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.866471 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.866934 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.867472 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.868001 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.868649 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.869178 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.869769 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.870291 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.870867 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.871459 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.874376 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.874376 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.874376 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.874376 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.875380 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.875380 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.875756 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.876339 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.876874 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.877396 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.877902 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.878410 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.879608 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.879608 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.880179 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.880533 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.881070 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.881620 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.882286 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.882812 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.883335 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.883887 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.884470 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.884997 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.885525 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.886047 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.886597 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.887120 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.887899 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.888867 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.888867 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.889349 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.889782 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.890353 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.890895 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.891423 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.891954 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.892526 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.893048 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.893577 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.894115 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.894683 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.895326 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.895857 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.896432 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.896967 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.897495 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.898028 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.898568 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.899094 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.899619 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.900201 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.900690 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.901216 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.901761 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.902294 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.902829 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.903519 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.904521 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.904521 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.905053 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.905698 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.906173 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.906705 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.907254 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.907793 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.908357 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.908899 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.909428 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.909970 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.910504 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.911045 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.911569 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.912127 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.912686 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.913233 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.913773 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.914335 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.914895 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.915456 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.915983 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.916816 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.917360 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.917905 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.918448 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.920173 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.920364 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.920808 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.921349 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.921885 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.922416 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.922947 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.923490 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.924029 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.924593 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.925165 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.925699 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.926234 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.926761 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.927294 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.927831 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.928409 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.929162 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.929696 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.930221 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.930762 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.931346 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.931804 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.932393 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.932939 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.933472 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.934206 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.935884 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.936398 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.936944 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.937472 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.938138 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.938667 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.939224 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.939758 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.940308 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.940836 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.941395 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.941921 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.942478 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.943208 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.943752 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.944306 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.945030 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.945559 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.946100 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.946655 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.947204 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.947769 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.948378 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.948887 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.949528 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.950613 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.951289 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.951709 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.952281 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.952806 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.953733 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.954508 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.955049 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.955598 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.956641 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.957204 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.957769 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.958325 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.958878 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.959408 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.959936 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.960511 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.961045 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.961582 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.962146 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.962670 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.963212 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.963741 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.964469 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.965003 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.966203 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.967925 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.967925 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.967925 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.968806 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.968806 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.972373 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.972373 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.972373 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.972373 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.972373 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.980609 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.981494 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.982407 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.983089 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.983794 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.985657 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.987199 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.988144 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.989078 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.990047 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.991083 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.991964 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.992893 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.993759 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.994671 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.998215 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:30.999513 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:31.000466 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:31.001593 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:31.002444 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:31.003312 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:31.006337 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:31.007426 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:31.008488 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:31.009109 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:31.009815 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:31.010410 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:31.011795 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:31.012502 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:31.013665 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:31.014098 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:31.014507 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:31.014876 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:31.015225 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:31.015590 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:31.015922 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:31.016267 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:31.016612 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:31.016947 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:31.017278 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:31.018700 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:31.018700 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:31.018700 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:31.018700 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:31.019654 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:31.019654 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:31.019654 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:31.020452 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:31.022186 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:31.022496 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:31.022792 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:31.023062 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:31.023308 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:31.023900 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:31.023900 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:31.025632 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:31.026789 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:31.027134 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:31.027466 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:31.027785 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:31.029954 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:31.029954 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:31.030297 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:31.030457 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:31.030804 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:31.031163 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:31.031467 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:31.031793 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:31.032605 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:31.032943 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:31.033268 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:31.033597 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:31.033926 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:31.034249 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:31.034568 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:31.034888 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:31.035191 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:31.035514 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:31.035834 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:31.036270 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:31.036543 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:31.036825 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:31.037138 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:31.037481 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:31.037805 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:31.038131 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:31.038522 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:31.038854 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:31.039450 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:31.039757 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:31.040126 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:31.040466 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:31.040800 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:31.041378 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:31.041692 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:31.042022 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:31.042337 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:31.042646 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:31.042966 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:31.043274 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:31.043627 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:31.044786 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:31.045244 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:31.045662 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:31.046145 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:31.046386 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:31.046884 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:31.047243 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:31.047569 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:31.047902 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:31.048309 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:31.048634 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:31.048953 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:31.049691 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:31.049691 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:31.050199 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:31.050199 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:31.050682 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:31.050936 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:31.051173 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:31.051411 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:31.051945 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:31.052268 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:31.052552 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:31.052798 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:31.053075 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:31.053320 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:31.053560 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:31.053985 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:31.054218 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:31.054442 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:31.054735 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:31.055039 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:31.055346 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:31.055662 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:31.055951 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:31.056294 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:31.056604 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:31.056916 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:31.057221 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:31.057530 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:31.057897 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:31.058223 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:31.058529 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:31.058840 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:31.059166 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:31.060398 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:31.060738 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:31.061111 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:31.061431 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:31.061788 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:31.062112 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:31.062700 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:31.063040 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:31.063363 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:31.063707 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:31.064040 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:31.064925 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:31.065239 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:31.065553 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:31.065888 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:31.066187 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:31.066506 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:31.066840 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:31.067164 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:31.067479 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:31.067793 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:31.068798 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:31.069127 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:31.069450 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:31.069767 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:31.070099 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:31.070521 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:31.070907 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:31.071141 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:31.071383 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:31.071798 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:31.072100 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:31.072553 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:31.073167 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:31.073742 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:31.074439 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:31.074945 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:31.076027 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:31.076495 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:31.077056 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:31.077578 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:31.078084 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:31.078778 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:31.079296 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:31.079820 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:31.080375 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:31.080951 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:31.082442 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:31.082995 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:31.083347 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:31.083904 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:31.084515 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:31.085070 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:31.085670 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:31.086194 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:31.086615 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:31.087003 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:31.087390 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:31.087777 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:31.088271 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:31.088834 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:31.089345 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:31.089816 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:31.090360 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:31.091318 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:31.092394 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:31.092394 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:31.093226 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:31.093562 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:31.094093 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:31.094627 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:31.095332 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:31.095911 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:31.096491 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:31.097018 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:31.097558 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:31.098175 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:31.098693 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:31.099272 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:31.099839 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:31.100476 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:31.101217 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:31.102052 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:31.102872 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:31.103642 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:31.104504 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:31.105544 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:31.107102 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:31.107922 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:31.108770 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:31.109584 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:31.110491 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:31.111261 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:31.112180 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:31.112890 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:31.113630 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:31.114348 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:31.114979 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:31.115746 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:31.116545 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:31.117338 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:31.118153 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:31.119712 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:31.120499 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:31.121332 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:31.121565 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:31.123463 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:31.124095 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:31.124713 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:31.125299 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:31.126103 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:31.126835 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:31.127660 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:31.128396 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:31.128969 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:31.129497 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:31.129987 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:31.130559 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:31.131175 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:31.131696 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:31.132282 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:31.132908 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:31.133483 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:31.134094 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:31.134668 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:31.135224 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:31.135783 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:31.136355 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:27:31.138250 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 16 18:27:31.207988 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO dbcounter [None req-6c780faa-14c4-4bf9-9c12-e407b2ffb876 None None] Registered counter for database nova_api Jun 16 18:27:31.233269 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_db.sqlalchemy.engines [None req-6c780faa-14c4-4bf9-9c12-e407b2ffb876 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117670) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 18:27:31.242021 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG dbcounter [-] [117670] Writer thread running {{(pid=117670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 18:27:31.254872 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: WARNING keystonemiddleware.auth_token [None req-1f017603-6fd3-472f-b1b8-d5af5a7eefff None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 16 18:27:31.268977 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: WARNING keystonemiddleware.auth_token [None req-1f017603-6fd3-472f-b1b8-d5af5a7eefff None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 16 18:27:31.307587 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.context [None req-6c780faa-14c4-4bf9-9c12-e407b2ffb876 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),aeb18649-0c63-4d1d-a910-334eb7a21817(cell1) {{(pid=117670) load_cells /opt/stack/nova/nova/context.py:464}} Jun 16 18:27:31.313480 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-6c780faa-14c4-4bf9-9c12-e407b2ffb876 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:27:31.315173 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-6c780faa-14c4-4bf9-9c12-e407b2ffb876 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:27:31.316264 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-6c780faa-14c4-4bf9-9c12-e407b2ffb876 None None] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:27:31.318470 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-6c780faa-14c4-4bf9-9c12-e407b2ffb876 None None] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:27:31.320746 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO dbcounter [None req-6c780faa-14c4-4bf9-9c12-e407b2ffb876 None None] Registered counter for database nova_cell0 Jun 16 18:27:31.326537 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO dbcounter [None req-6c780faa-14c4-4bf9-9c12-e407b2ffb876 None None] Registered counter for database nova_cell1 Jun 16 18:27:31.336170 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_db.sqlalchemy.engines [None req-6c780faa-14c4-4bf9-9c12-e407b2ffb876 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117670) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 18:27:31.339978 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG dbcounter [-] [117670] Writer thread running {{(pid=117670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 18:27:31.340908 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_db.sqlalchemy.engines [None req-6c780faa-14c4-4bf9-9c12-e407b2ffb876 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117670) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 18:27:31.502132 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG dbcounter [-] [117670] Writer thread running {{(pid=117670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 18:27:31.520798 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO dbcounter [None req-6c780faa-14c4-4bf9-9c12-e407b2ffb876 None None] Registered counter for database nova_cell0 Jun 16 18:27:31.534333 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_db.sqlalchemy.engines [None req-6c780faa-14c4-4bf9-9c12-e407b2ffb876 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117670) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 18:27:31.545306 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG dbcounter [-] [117670] Writer thread running {{(pid=117670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 18:27:31.704222 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: WARNING keystonemiddleware.auth_token [None req-1f017603-6fd3-472f-b1b8-d5af5a7eefff None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 16 18:27:31.711251 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: WARNING keystonemiddleware.auth_token [None req-1f017603-6fd3-472f-b1b8-d5af5a7eefff None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 16 18:27:31.717639 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x55cd680699c0 pid: 117671 (default app) Jun 16 18:27:31.913493 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: WARNING keystonemiddleware.auth_token [None req-6c780faa-14c4-4bf9-9c12-e407b2ffb876 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 16 18:27:31.922116 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: WARNING keystonemiddleware.auth_token [None req-6c780faa-14c4-4bf9-9c12-e407b2ffb876 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 16 18:27:32.279760 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: WARNING keystonemiddleware.auth_token [None req-6c780faa-14c4-4bf9-9c12-e407b2ffb876 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 16 18:27:32.286004 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: WARNING keystonemiddleware.auth_token [None req-6c780faa-14c4-4bf9-9c12-e407b2ffb876 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 16 18:27:32.291812 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: WSGI app 0 (mountpoint='') ready in 8 seconds on interpreter 0x55cd680699c0 pid: 117670 (default app) Jun 16 18:28:21.155135 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG dbcounter [-] [117671] Writing DB stats nova_api:SELECT=3 {{(pid=117671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:28:21.158062 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG dbcounter [-] [117671] Writing DB stats nova_cell0:SELECT=3 {{(pid=117671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:28:21.158062 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG dbcounter [-] [117671] Writing DB stats nova_cell1:SELECT=3 {{(pid=117671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:28:21.159065 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG dbcounter [-] [117671] Writing DB stats nova_cell0:SELECT=3 {{(pid=117671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:28:22.953534 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-53dda86c-537c-4c0f-a3b8-589d8534f9bb tempest-VolumesNegativeTest-1770934138 tempest-VolumesNegativeTest-1770934138-project] Action: 'create', calling method: .version_select at 0x7fbb31e2d790>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1413512343", "metadata": {"Type": "work"}}} {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:28:22.978012 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-53dda86c-537c-4c0f-a3b8-589d8534f9bb tempest-VolumesNegativeTest-1770934138 tempest-VolumesNegativeTest-1770934138-project] Request method failure captured: Jun 16 18:28:22.978012 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 16 18:28:22.978012 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: Accept: application/json Jun 16 18:28:22.978012 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: Accept-Encoding: identity Jun 16 18:28:22.978012 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: Connection: close Jun 16 18:28:22.978012 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: Content-Length: 122 Jun 16 18:28:22.978012 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: Content-Type: application/json Jun 16 18:28:22.978012 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: Host: 10.222.0.30 Jun 16 18:28:22.978012 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: Openstack-System-Scope: None Jun 16 18:28:22.978012 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: User-Agent: python-urllib3/1.26.9 Jun 16 18:28:22.978012 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Auth-Token: gAAAAABiq3ZEVeOC46Tehfx4WGm7WPWs_6dq0vL5QPN1eDevtJY_UYj1WoJHSvgqo44VCCPZJ97SjJeEMhrUwMLM8LKb6bUfNiHlYxuObWBE8M75OaY_DWIEfpLfcQgD0HbN__va1KrT9e7mt9k_p5Yopsxch4fzPgBsteZCVi6gWxxKxtm1kk0 Jun 16 18:28:22.978012 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Domain-Id: None Jun 16 18:28:22.978012 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Domain-Name: None Jun 16 18:28:22.978012 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Identity-Status: Confirmed Jun 16 18:28:22.978012 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Is-Admin-Project: True Jun 16 18:28:22.978012 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Project-Domain-Id: default Jun 16 18:28:22.978012 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Project-Domain-Name: Default Jun 16 18:28:22.978012 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Project-Id: a367968c80bb4ce9973d18c1674c01b1 Jun 16 18:28:22.978012 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Project-Name: tempest-VolumesNegativeTest-1770934138 Jun 16 18:28:22.978012 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Role: reader,member Jun 16 18:28:22.978012 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Roles: reader,member Jun 16 18:28:22.980270 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a367968c80bb4ce9973d18c1674c01b1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a367968c80bb4ce9973d18c1674c01b1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_a367968c80bb4ce9973d18c1674c01b1", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/a367968c80bb4ce9973d18c1674c01b1"}]}] Jun 16 18:28:22.980270 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Tenant: tempest-VolumesNegativeTest-1770934138 Jun 16 18:28:22.980270 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Tenant-Id: a367968c80bb4ce9973d18c1674c01b1 Jun 16 18:28:22.980270 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Tenant-Name: tempest-VolumesNegativeTest-1770934138 Jun 16 18:28:22.980270 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-User: tempest-VolumesNegativeTest-1770934138-project Jun 16 18:28:22.980270 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-User-Domain-Id: default Jun 16 18:28:22.980270 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-User-Domain-Name: Default Jun 16 18:28:22.980270 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-User-Id: bc80a29a78af4201becf229b0a964fa3 Jun 16 18:28:22.980270 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-User-Name: tempest-VolumesNegativeTest-1770934138-project Jun 16 18:28:22.980270 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: Jun 16 18:28:22.980270 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1413512343", "metadata": {"Type": "work"}}} Jun 16 18:28:22.980270 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: method: Jun 16 18:28:22.980270 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 16 18:28:22.981312 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1413512343', 'metadata': {'Type': 'work'}}}} Jun 16 18:28:22.981312 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:28:22.981312 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:28:22.981312 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 16 18:28:22.981312 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 16 18:28:22.981312 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 16 18:28:22.981312 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi raise error Jun 16 18:28:22.981312 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jun 16 18:28:22.981312 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Jun 16 18:28:22.981312 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jun 16 18:28:22.981312 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 16 18:28:22.981312 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Jun 16 18:28:22.981312 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 16 18:28:22.981312 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi '#$%' Jun 16 18:28:22.981312 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Jun 16 18:28:22.981312 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:28:22.981312 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Jun 16 18:28:22.981312 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:28:22.981312 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:28:22.981312 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:28:22.981312 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:28:22.981312 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:28:22.983105 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 18:28:22.983105 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 18:28:22.983105 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:28:22.983105 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:28:22.983105 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 16 18:28:22.983105 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 16 18:28:22.983105 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 16 18:28:22.983105 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 16 18:28:22.983105 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 16 18:28:22.983105 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 16 18:28:22.983105 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 16 18:28:22.983105 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Jun 16 18:28:22.983105 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:28:22.983105 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Jun 16 18:28:22.983105 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:28:22.983105 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:28:22.983105 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:28:22.983105 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 16 18:28:22.983105 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 16 18:28:22.984647 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 16 18:28:22.984647 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Jun 16 18:28:22.986600 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-53dda86c-537c-4c0f-a3b8-589d8534f9bb tempest-VolumesNegativeTest-1770934138 tempest-VolumesNegativeTest-1770934138-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=117671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:28:22.988066 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-53dda86c-537c-4c0f-a3b8-589d8534f9bb tempest-VolumesNegativeTest-1770934138 tempest-VolumesNegativeTest-1770934138-project] 10.222.0.30 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.858288 Jun 16 18:28:22.988913 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 1/1] 10.222.0.30 () {60 vars in 1155 bytes} [Thu Jun 16 18:28:21 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 1862 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 16 18:28:23.023313 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG dbcounter [-] [117670] Writing DB stats nova_api:SELECT=3 {{(pid=117670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:28:23.037100 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG dbcounter [-] [117670] Writing DB stats nova_cell1:SELECT=3 {{(pid=117670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:28:23.045053 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG dbcounter [-] [117670] Writing DB stats nova_cell0:SELECT=3 {{(pid=117670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:28:23.047035 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG dbcounter [-] [117670] Writing DB stats nova_cell0:SELECT=3 {{(pid=117670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:28:23.771155 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-8b705f5e-16b0-46fe-9259-624b9f06d083 tempest-VolumesNegativeTest-1770934138 tempest-VolumesNegativeTest-1770934138-project] Action: 'create', calling method: .version_select at 0x7fbb31e341f0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1804721841", "metadata": {"Type": "work"}}} {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:28:23.776087 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-8b705f5e-16b0-46fe-9259-624b9f06d083 tempest-VolumesNegativeTest-1770934138 tempest-VolumesNegativeTest-1770934138-project] Request method failure captured: Jun 16 18:28:23.776087 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 16 18:28:23.776087 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: Accept: application/json Jun 16 18:28:23.776087 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: Accept-Encoding: identity Jun 16 18:28:23.776087 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: Connection: close Jun 16 18:28:23.776087 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: Content-Length: 120 Jun 16 18:28:23.776087 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: Content-Type: application/json Jun 16 18:28:23.776087 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: Host: 10.222.0.30 Jun 16 18:28:23.776087 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: Openstack-System-Scope: None Jun 16 18:28:23.776087 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: User-Agent: python-urllib3/1.26.9 Jun 16 18:28:23.776087 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Auth-Token: gAAAAABiq3ZEVeOC46Tehfx4WGm7WPWs_6dq0vL5QPN1eDevtJY_UYj1WoJHSvgqo44VCCPZJ97SjJeEMhrUwMLM8LKb6bUfNiHlYxuObWBE8M75OaY_DWIEfpLfcQgD0HbN__va1KrT9e7mt9k_p5Yopsxch4fzPgBsteZCVi6gWxxKxtm1kk0 Jun 16 18:28:23.776087 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Domain-Id: None Jun 16 18:28:23.776087 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Domain-Name: None Jun 16 18:28:23.776087 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Identity-Status: Confirmed Jun 16 18:28:23.776087 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Is-Admin-Project: True Jun 16 18:28:23.776087 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Project-Domain-Id: default Jun 16 18:28:23.776087 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Project-Domain-Name: Default Jun 16 18:28:23.776087 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Project-Id: a367968c80bb4ce9973d18c1674c01b1 Jun 16 18:28:23.776087 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Project-Name: tempest-VolumesNegativeTest-1770934138 Jun 16 18:28:23.776087 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Role: reader,member Jun 16 18:28:23.776087 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Roles: reader,member Jun 16 18:28:23.778414 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a367968c80bb4ce9973d18c1674c01b1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a367968c80bb4ce9973d18c1674c01b1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_a367968c80bb4ce9973d18c1674c01b1", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/a367968c80bb4ce9973d18c1674c01b1"}]}] Jun 16 18:28:23.778414 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Tenant: tempest-VolumesNegativeTest-1770934138 Jun 16 18:28:23.778414 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Tenant-Id: a367968c80bb4ce9973d18c1674c01b1 Jun 16 18:28:23.778414 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Tenant-Name: tempest-VolumesNegativeTest-1770934138 Jun 16 18:28:23.778414 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-User: tempest-VolumesNegativeTest-1770934138-project Jun 16 18:28:23.778414 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-User-Domain-Id: default Jun 16 18:28:23.778414 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-User-Domain-Name: Default Jun 16 18:28:23.778414 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-User-Id: bc80a29a78af4201becf229b0a964fa3 Jun 16 18:28:23.778414 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-User-Name: tempest-VolumesNegativeTest-1770934138-project Jun 16 18:28:23.778414 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: Jun 16 18:28:23.778414 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1804721841", "metadata": {"Type": "work"}}} Jun 16 18:28:23.778414 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: method: Jun 16 18:28:23.778414 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 16 18:28:23.779444 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1804721841', 'metadata': {'Type': 'work'}}}} Jun 16 18:28:23.779444 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:28:23.779444 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:28:23.779444 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 16 18:28:23.779444 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 16 18:28:23.779444 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 16 18:28:23.779444 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi raise error Jun 16 18:28:23.779444 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jun 16 18:28:23.779444 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi Jun 16 18:28:23.779444 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jun 16 18:28:23.779444 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 16 18:28:23.779444 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi Jun 16 18:28:23.779444 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 16 18:28:23.779444 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi '0' Jun 16 18:28:23.779444 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi Jun 16 18:28:23.779444 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:28:23.779444 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi Jun 16 18:28:23.779444 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:28:23.779444 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:28:23.779444 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:28:23.779444 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:28:23.779444 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:28:23.781320 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 18:28:23.781320 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 18:28:23.781320 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:28:23.781320 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:28:23.781320 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 16 18:28:23.781320 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 16 18:28:23.781320 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 16 18:28:23.781320 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 16 18:28:23.781320 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 16 18:28:23.781320 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 16 18:28:23.781320 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 16 18:28:23.781320 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi Jun 16 18:28:23.781320 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:28:23.781320 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi Jun 16 18:28:23.781320 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:28:23.781320 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:28:23.781320 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:28:23.781320 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 16 18:28:23.781320 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 16 18:28:23.783449 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 16 18:28:23.783449 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi Jun 16 18:28:23.785880 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-8b705f5e-16b0-46fe-9259-624b9f06d083 tempest-VolumesNegativeTest-1770934138 tempest-VolumesNegativeTest-1770934138-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=117670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:28:23.787247 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-8b705f5e-16b0-46fe-9259-624b9f06d083 tempest-VolumesNegativeTest-1770934138 tempest-VolumesNegativeTest-1770934138-project] 10.222.0.30 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.788020 Jun 16 18:28:23.788569 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 1/2] 10.222.0.30 () {60 vars in 1155 bytes} [Thu Jun 16 18:28:22 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 791 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 16 18:28:23.805337 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-ef3d9368-c2f4-47c8-a2b2-83ab6468f673 tempest-VolumesNegativeTest-1770934138 tempest-VolumesNegativeTest-1770934138-project] Action: 'create', calling method: .version_select at 0x7fbb31df8a60>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-77161404", "metadata": {"Type": "work"}}} {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:28:23.823586 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-ef3d9368-c2f4-47c8-a2b2-83ab6468f673 tempest-VolumesNegativeTest-1770934138 tempest-VolumesNegativeTest-1770934138-project] Request method failure captured: Jun 16 18:28:23.823586 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 16 18:28:23.823586 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: Accept: application/json Jun 16 18:28:23.823586 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: Accept-Encoding: identity Jun 16 18:28:23.823586 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: Connection: close Jun 16 18:28:23.823586 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: Content-Length: 117 Jun 16 18:28:23.823586 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: Content-Type: application/json Jun 16 18:28:23.823586 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: Host: 10.222.0.30 Jun 16 18:28:23.823586 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: Openstack-System-Scope: None Jun 16 18:28:23.823586 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: User-Agent: python-urllib3/1.26.9 Jun 16 18:28:23.823586 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Auth-Token: gAAAAABiq3ZEVeOC46Tehfx4WGm7WPWs_6dq0vL5QPN1eDevtJY_UYj1WoJHSvgqo44VCCPZJ97SjJeEMhrUwMLM8LKb6bUfNiHlYxuObWBE8M75OaY_DWIEfpLfcQgD0HbN__va1KrT9e7mt9k_p5Yopsxch4fzPgBsteZCVi6gWxxKxtm1kk0 Jun 16 18:28:23.823586 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Domain-Id: None Jun 16 18:28:23.823586 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Domain-Name: None Jun 16 18:28:23.823586 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Identity-Status: Confirmed Jun 16 18:28:23.823586 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Is-Admin-Project: True Jun 16 18:28:23.823586 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Project-Domain-Id: default Jun 16 18:28:23.823586 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Project-Domain-Name: Default Jun 16 18:28:23.823586 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Project-Id: a367968c80bb4ce9973d18c1674c01b1 Jun 16 18:28:23.823586 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Project-Name: tempest-VolumesNegativeTest-1770934138 Jun 16 18:28:23.823586 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Role: reader,member Jun 16 18:28:23.823586 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Roles: reader,member Jun 16 18:28:23.825919 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a367968c80bb4ce9973d18c1674c01b1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a367968c80bb4ce9973d18c1674c01b1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_a367968c80bb4ce9973d18c1674c01b1", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/a367968c80bb4ce9973d18c1674c01b1"}]}] Jun 16 18:28:23.825919 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Tenant: tempest-VolumesNegativeTest-1770934138 Jun 16 18:28:23.825919 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Tenant-Id: a367968c80bb4ce9973d18c1674c01b1 Jun 16 18:28:23.825919 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Tenant-Name: tempest-VolumesNegativeTest-1770934138 Jun 16 18:28:23.825919 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-User: tempest-VolumesNegativeTest-1770934138-project Jun 16 18:28:23.825919 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-User-Domain-Id: default Jun 16 18:28:23.825919 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-User-Domain-Name: Default Jun 16 18:28:23.825919 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-User-Id: bc80a29a78af4201becf229b0a964fa3 Jun 16 18:28:23.825919 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-User-Name: tempest-VolumesNegativeTest-1770934138-project Jun 16 18:28:23.825919 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: Jun 16 18:28:23.825919 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-77161404", "metadata": {"Type": "work"}}} Jun 16 18:28:23.825919 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: method: Jun 16 18:28:23.825919 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 16 18:28:23.826867 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-77161404', 'metadata': {'Type': 'work'}}}} Jun 16 18:28:23.826867 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:28:23.826867 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:28:23.826867 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 16 18:28:23.826867 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 16 18:28:23.826867 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 16 18:28:23.826867 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi raise error Jun 16 18:28:23.826867 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jun 16 18:28:23.826867 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Jun 16 18:28:23.826867 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jun 16 18:28:23.826867 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 16 18:28:23.826867 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Jun 16 18:28:23.826867 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 16 18:28:23.826867 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi '' Jun 16 18:28:23.826867 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Jun 16 18:28:23.826867 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:28:23.826867 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Jun 16 18:28:23.826867 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:28:23.826867 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:28:23.826867 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:28:23.826867 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:28:23.826867 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:28:23.829108 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 18:28:23.829108 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 18:28:23.829108 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:28:23.829108 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:28:23.829108 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 16 18:28:23.829108 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 16 18:28:23.829108 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 16 18:28:23.829108 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 16 18:28:23.829108 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 16 18:28:23.829108 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 16 18:28:23.829108 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 16 18:28:23.829108 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Jun 16 18:28:23.829108 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:28:23.829108 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Jun 16 18:28:23.829108 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:28:23.829108 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:28:23.829108 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:28:23.829108 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 16 18:28:23.829108 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 16 18:28:23.832907 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 16 18:28:23.832907 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Jun 16 18:28:23.832907 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-ef3d9368-c2f4-47c8-a2b2-83ab6468f673 tempest-VolumesNegativeTest-1770934138 tempest-VolumesNegativeTest-1770934138-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=117671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:28:23.832907 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-ef3d9368-c2f4-47c8-a2b2-83ab6468f673 tempest-VolumesNegativeTest-1770934138 tempest-VolumesNegativeTest-1770934138-project] 10.222.0.30 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.029804 Jun 16 18:28:23.842941 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-a2bcda37-8a16-416a-bac4-0509dacf7d41 tempest-VolumesNegativeTest-1770934138 tempest-VolumesNegativeTest-1770934138-project] Calling method '.version_select at 0x7fbb31d555e0>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:28:23.847718 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 2/3] 10.222.0.30 () {60 vars in 1155 bytes} [Thu Jun 16 18:28:23 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 52 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jun 16 18:28:24.476305 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.wsgi [None req-a2bcda37-8a16-416a-bac4-0509dacf7d41 tempest-VolumesNegativeTest-1770934138 tempest-VolumesNegativeTest-1770934138-project] HTTP exception thrown: Volume tempest-invalid-1232263356 could not be found. Jun 16 18:28:24.598919 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-a2bcda37-8a16-416a-bac4-0509dacf7d41 tempest-VolumesNegativeTest-1770934138 tempest-VolumesNegativeTest-1770934138-project] Request method failure captured: Jun 16 18:28:24.598919 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1232263356 HTTP/1.1 Jun 16 18:28:24.598919 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: Accept: application/json Jun 16 18:28:24.598919 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: Accept-Encoding: identity Jun 16 18:28:24.598919 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: Connection: close Jun 16 18:28:24.598919 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: Content-Length: 0 Jun 16 18:28:24.598919 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: Content-Type: application/json Jun 16 18:28:24.598919 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: Host: 10.222.0.30 Jun 16 18:28:24.598919 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: Openstack-System-Scope: None Jun 16 18:28:24.598919 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: User-Agent: python-urllib3/1.26.9 Jun 16 18:28:24.598919 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Auth-Token: gAAAAABiq3ZEVeOC46Tehfx4WGm7WPWs_6dq0vL5QPN1eDevtJY_UYj1WoJHSvgqo44VCCPZJ97SjJeEMhrUwMLM8LKb6bUfNiHlYxuObWBE8M75OaY_DWIEfpLfcQgD0HbN__va1KrT9e7mt9k_p5Yopsxch4fzPgBsteZCVi6gWxxKxtm1kk0 Jun 16 18:28:24.598919 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Domain-Id: None Jun 16 18:28:24.598919 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Domain-Name: None Jun 16 18:28:24.598919 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Identity-Status: Confirmed Jun 16 18:28:24.598919 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Is-Admin-Project: True Jun 16 18:28:24.598919 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Project-Domain-Id: default Jun 16 18:28:24.598919 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Project-Domain-Name: Default Jun 16 18:28:24.598919 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Project-Id: a367968c80bb4ce9973d18c1674c01b1 Jun 16 18:28:24.598919 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Project-Name: tempest-VolumesNegativeTest-1770934138 Jun 16 18:28:24.598919 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Role: reader,member Jun 16 18:28:24.598919 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Roles: reader,member Jun 16 18:28:24.607475 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a367968c80bb4ce9973d18c1674c01b1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a367968c80bb4ce9973d18c1674c01b1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_a367968c80bb4ce9973d18c1674c01b1", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/a367968c80bb4ce9973d18c1674c01b1"}]}] Jun 16 18:28:24.607475 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Tenant: tempest-VolumesNegativeTest-1770934138 Jun 16 18:28:24.607475 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Tenant-Id: a367968c80bb4ce9973d18c1674c01b1 Jun 16 18:28:24.607475 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Tenant-Name: tempest-VolumesNegativeTest-1770934138 Jun 16 18:28:24.607475 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-User: tempest-VolumesNegativeTest-1770934138-project Jun 16 18:28:24.607475 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-User-Domain-Id: default Jun 16 18:28:24.607475 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-User-Domain-Name: Default Jun 16 18:28:24.607475 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-User-Id: bc80a29a78af4201becf229b0a964fa3 Jun 16 18:28:24.607475 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-User-Name: tempest-VolumesNegativeTest-1770934138-project Jun 16 18:28:24.607475 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: method: Jun 16 18:28:24.607475 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: exception: Volume tempest-invalid-1232263356 could not be found. Jun 16 18:28:24.607475 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: action_args: {'id': 'tempest-invalid-1232263356'} Jun 16 18:28:24.607475 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:28:24.611851 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:28:24.611851 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 16 18:28:24.611851 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 16 18:28:24.611851 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 16 18:28:24.611851 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 16 18:28:24.611851 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 16 18:28:24.611851 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 16 18:28:24.611851 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 16 18:28:24.611851 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 16 18:28:24.611851 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 16 18:28:24.611851 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 16 18:28:24.611851 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 18:28:24.611851 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 18:28:24.611851 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 18:28:24.611851 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 18:28:24.611851 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1232263356 could not be found. (HTTP 404) (Request-ID: req-dabb13a1-87a2-40e5-b1c9-6ff9a983cde1) Jun 16 18:28:24.611851 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi Jun 16 18:28:24.611851 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:28:24.611851 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi Jun 16 18:28:24.616456 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:28:24.616456 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 16 18:28:24.616456 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 16 18:28:24.616456 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 16 18:28:24.616456 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 16 18:28:24.616456 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 16 18:28:24.616456 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 16 18:28:24.616456 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 16 18:28:24.616456 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 16 18:28:24.616456 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 16 18:28:24.616456 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 16 18:28:24.616456 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 16 18:28:24.616456 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 16 18:28:24.616456 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 16 18:28:24.616456 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 16 18:28:24.616456 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 16 18:28:24.616456 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 16 18:28:24.616456 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 16 18:28:24.616456 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 16 18:28:24.627670 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 18:28:24.627670 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 18:28:24.627670 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 18:28:24.627670 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 18:28:24.627670 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1232263356 could not be found. Jun 16 18:28:24.627670 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi Jun 16 18:28:24.627670 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:28:24.627670 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi Jun 16 18:28:24.627670 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:28:24.627670 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:28:24.627670 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:28:24.627670 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:28:24.627670 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:28:24.627670 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 18:28:24.627670 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 18:28:24.627670 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:28:24.627670 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:28:24.627670 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 16 18:28:24.627670 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:28:24.627670 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1232263356 could not be found. Jun 16 18:28:24.639384 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi Jun 16 18:28:24.639384 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:28:24.639384 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi Jun 16 18:28:24.639384 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:28:24.639384 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:28:24.639384 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:28:24.639384 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:28:24.639384 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:28:24.639384 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1232263356 could not be found. Jun 16 18:28:24.639384 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi Jun 16 18:28:24.639384 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-a2bcda37-8a16-416a-bac4-0509dacf7d41 tempest-VolumesNegativeTest-1770934138 tempest-VolumesNegativeTest-1770934138-project] Returning 404 to user: Volume tempest-invalid-1232263356 could not be found. {{(pid=117670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:28:24.639384 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-a2bcda37-8a16-416a-bac4-0509dacf7d41 tempest-VolumesNegativeTest-1770934138 tempest-VolumesNegativeTest-1770934138-project] 10.222.0.30 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1232263356" status: 404 len: 99 microversion: 2.1 time: 0.691530 Jun 16 18:28:24.639384 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 2/4] 10.222.0.30 () {58 vars in 1217 bytes} [Thu Jun 16 18:28:23 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1232263356 => generated 99 bytes in 701 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 16 18:28:24.642947 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-d4d71a10-b224-4880-89ff-22f1dc64eea0 tempest-VolumesNegativeTest-1770934138 tempest-VolumesNegativeTest-1770934138-project] 10.222.0.30 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.012338 Jun 16 18:28:24.642947 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 3/5] 10.222.0.30 () {58 vars in 1139 bytes} [Thu Jun 16 18:28:24 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 15 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jun 16 18:28:24.644140 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-4cedec1e-eb8a-4896-a4f8-076ab328f218 tempest-VolumesNegativeTest-1770934138 tempest-VolumesNegativeTest-1770934138-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.015582 Jun 16 18:28:24.644140 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 3/6] 10.222.0.30 () {58 vars in 1136 bytes} [Thu Jun 16 18:28:24 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 25 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jun 16 18:28:24.644655 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-2d23b7e0-a6f2-41ec-84a5-ad49f5813aca tempest-VolumesNegativeTest-1770934138 tempest-VolumesNegativeTest-1770934138-project] Calling method '.version_select at 0x7fbb31df8af0>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:28:24.899338 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-b10b4bce-9ada-49f5-b059-f09bd85b3e0a tempest-VolumesTestJSON-2022403013 tempest-VolumesTestJSON-2022403013-project] Calling method '.version_select at 0x7fbb31c3a160>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:28:25.225349 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-b10b4bce-9ada-49f5-b059-f09bd85b3e0a tempest-VolumesTestJSON-2022403013 tempest-VolumesTestJSON-2022403013-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/adec3f2a-e3e0-4403-83b3-1a4be8eb428e" status: 200 len: 350 microversion: 2.1 time: 0.336790 Jun 16 18:28:25.226727 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 4/7] 10.222.0.30 () {58 vars in 1244 bytes} [Thu Jun 16 18:28:24 2022] GET /compute/v2.1/os-volumes/adec3f2a-e3e0-4403-83b3-1a4be8eb428e => generated 350 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 18:28:25.238544 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.wsgi [None req-2d23b7e0-a6f2-41ec-84a5-ad49f5813aca tempest-VolumesNegativeTest-1770934138 tempest-VolumesNegativeTest-1770934138-project] HTTP exception thrown: Volume 0b6972aa-ff16-4166-9162-ff8c3213f4f7 could not be found. Jun 16 18:28:25.260312 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-2d23b7e0-a6f2-41ec-84a5-ad49f5813aca tempest-VolumesNegativeTest-1770934138 tempest-VolumesNegativeTest-1770934138-project] Request method failure captured: Jun 16 18:28:25.260312 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: request: DELETE /compute/v2.1/os-volumes/0b6972aa-ff16-4166-9162-ff8c3213f4f7 HTTP/1.1 Jun 16 18:28:25.260312 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: Accept: application/json Jun 16 18:28:25.260312 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: Accept-Encoding: identity Jun 16 18:28:25.260312 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: Connection: close Jun 16 18:28:25.260312 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: Content-Length: 0 Jun 16 18:28:25.260312 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: Content-Type: application/json Jun 16 18:28:25.260312 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: Host: 10.222.0.30 Jun 16 18:28:25.260312 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: Openstack-System-Scope: None Jun 16 18:28:25.260312 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: User-Agent: python-urllib3/1.26.9 Jun 16 18:28:25.260312 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Auth-Token: gAAAAABiq3ZEVeOC46Tehfx4WGm7WPWs_6dq0vL5QPN1eDevtJY_UYj1WoJHSvgqo44VCCPZJ97SjJeEMhrUwMLM8LKb6bUfNiHlYxuObWBE8M75OaY_DWIEfpLfcQgD0HbN__va1KrT9e7mt9k_p5Yopsxch4fzPgBsteZCVi6gWxxKxtm1kk0 Jun 16 18:28:25.260312 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Domain-Id: None Jun 16 18:28:25.260312 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Domain-Name: None Jun 16 18:28:25.260312 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Identity-Status: Confirmed Jun 16 18:28:25.260312 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Is-Admin-Project: True Jun 16 18:28:25.260312 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Project-Domain-Id: default Jun 16 18:28:25.260312 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Project-Domain-Name: Default Jun 16 18:28:25.260312 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Project-Id: a367968c80bb4ce9973d18c1674c01b1 Jun 16 18:28:25.260312 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Project-Name: tempest-VolumesNegativeTest-1770934138 Jun 16 18:28:25.260312 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Role: reader,member Jun 16 18:28:25.260312 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Roles: reader,member Jun 16 18:28:25.264522 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a367968c80bb4ce9973d18c1674c01b1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a367968c80bb4ce9973d18c1674c01b1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_a367968c80bb4ce9973d18c1674c01b1", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/a367968c80bb4ce9973d18c1674c01b1"}]}] Jun 16 18:28:25.264522 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Tenant: tempest-VolumesNegativeTest-1770934138 Jun 16 18:28:25.264522 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Tenant-Id: a367968c80bb4ce9973d18c1674c01b1 Jun 16 18:28:25.264522 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Tenant-Name: tempest-VolumesNegativeTest-1770934138 Jun 16 18:28:25.264522 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-User: tempest-VolumesNegativeTest-1770934138-project Jun 16 18:28:25.264522 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-User-Domain-Id: default Jun 16 18:28:25.264522 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-User-Domain-Name: Default Jun 16 18:28:25.264522 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-User-Id: bc80a29a78af4201becf229b0a964fa3 Jun 16 18:28:25.264522 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-User-Name: tempest-VolumesNegativeTest-1770934138-project Jun 16 18:28:25.264522 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: method: Jun 16 18:28:25.264522 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: exception: Volume 0b6972aa-ff16-4166-9162-ff8c3213f4f7 could not be found. Jun 16 18:28:25.264522 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: action_args: {'id': '0b6972aa-ff16-4166-9162-ff8c3213f4f7'} Jun 16 18:28:25.264522 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:28:25.266198 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:28:25.266198 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 16 18:28:25.266198 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 16 18:28:25.266198 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 16 18:28:25.266198 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 16 18:28:25.266198 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 16 18:28:25.266198 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 16 18:28:25.266198 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 16 18:28:25.266198 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 16 18:28:25.266198 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 16 18:28:25.266198 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 16 18:28:25.266198 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 18:28:25.266198 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 18:28:25.266198 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 18:28:25.266198 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 18:28:25.266198 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 0b6972aa-ff16-4166-9162-ff8c3213f4f7 could not be found. (HTTP 404) (Request-ID: req-21e15e58-5876-45ce-9a6b-4a75a456b82a) Jun 16 18:28:25.266198 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Jun 16 18:28:25.266198 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:28:25.266198 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Jun 16 18:28:25.268669 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:28:25.268669 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 16 18:28:25.268669 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 16 18:28:25.268669 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 16 18:28:25.268669 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 16 18:28:25.268669 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 16 18:28:25.268669 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 16 18:28:25.268669 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 16 18:28:25.268669 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 16 18:28:25.268669 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 16 18:28:25.268669 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 16 18:28:25.268669 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 16 18:28:25.268669 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 16 18:28:25.268669 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 16 18:28:25.268669 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 16 18:28:25.268669 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 16 18:28:25.268669 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 16 18:28:25.268669 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 16 18:28:25.268669 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 16 18:28:25.271065 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 18:28:25.271065 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 18:28:25.271065 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 18:28:25.271065 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 18:28:25.271065 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 0b6972aa-ff16-4166-9162-ff8c3213f4f7 could not be found. Jun 16 18:28:25.271065 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Jun 16 18:28:25.271065 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:28:25.271065 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Jun 16 18:28:25.271065 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:28:25.271065 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:28:25.271065 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:28:25.271065 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:28:25.271065 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:28:25.271065 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 18:28:25.271065 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 18:28:25.271065 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:28:25.271065 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:28:25.271065 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 16 18:28:25.271065 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:28:25.273585 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 0b6972aa-ff16-4166-9162-ff8c3213f4f7 could not be found. Jun 16 18:28:25.273585 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Jun 16 18:28:25.273585 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:28:25.273585 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Jun 16 18:28:25.273585 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:28:25.273585 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:28:25.273585 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:28:25.273585 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:28:25.273585 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:28:25.273585 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 0b6972aa-ff16-4166-9162-ff8c3213f4f7 could not be found. Jun 16 18:28:25.273585 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Jun 16 18:28:25.273585 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-2d23b7e0-a6f2-41ec-84a5-ad49f5813aca tempest-VolumesNegativeTest-1770934138 tempest-VolumesNegativeTest-1770934138-project] Returning 404 to user: Volume 0b6972aa-ff16-4166-9162-ff8c3213f4f7 could not be found. {{(pid=117671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:28:25.273585 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-2d23b7e0-a6f2-41ec-84a5-ad49f5813aca tempest-VolumesNegativeTest-1770934138 tempest-VolumesNegativeTest-1770934138-project] 10.222.0.30 "DELETE /compute/v2.1/os-volumes/0b6972aa-ff16-4166-9162-ff8c3213f4f7" status: 404 len: 109 microversion: 2.1 time: 0.670354 Jun 16 18:28:25.275163 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 4/8] 10.222.0.30 () {58 vars in 1247 bytes} [Thu Jun 16 18:28:24 2022] DELETE /compute/v2.1/os-volumes/0b6972aa-ff16-4166-9162-ff8c3213f4f7 => generated 109 bytes in 683 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:28:25.293740 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-228fc369-771c-43b1-85d8-2af1b4b6b87a tempest-VolumesNegativeTest-1770934138 tempest-VolumesNegativeTest-1770934138-project] Calling method '.version_select at 0x7fbb31e34ee0>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:28:26.184869 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.wsgi [None req-228fc369-771c-43b1-85d8-2af1b4b6b87a tempest-VolumesNegativeTest-1770934138 tempest-VolumesNegativeTest-1770934138-project] HTTP exception thrown: Volume 8ce7655f-f35e-4b92-b4be-9089acd4edb4 could not be found. Jun 16 18:28:26.190384 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-228fc369-771c-43b1-85d8-2af1b4b6b87a tempest-VolumesNegativeTest-1770934138 tempest-VolumesNegativeTest-1770934138-project] Request method failure captured: Jun 16 18:28:26.190384 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: request: GET /compute/v2.1/os-volumes/8ce7655f-f35e-4b92-b4be-9089acd4edb4 HTTP/1.1 Jun 16 18:28:26.190384 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: Accept: application/json Jun 16 18:28:26.190384 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: Accept-Encoding: identity Jun 16 18:28:26.190384 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: Connection: close Jun 16 18:28:26.190384 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: Content-Length: 0 Jun 16 18:28:26.190384 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: Content-Type: application/json Jun 16 18:28:26.190384 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: Host: 10.222.0.30 Jun 16 18:28:26.190384 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: Openstack-System-Scope: None Jun 16 18:28:26.190384 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: User-Agent: python-urllib3/1.26.9 Jun 16 18:28:26.190384 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Auth-Token: gAAAAABiq3ZEVeOC46Tehfx4WGm7WPWs_6dq0vL5QPN1eDevtJY_UYj1WoJHSvgqo44VCCPZJ97SjJeEMhrUwMLM8LKb6bUfNiHlYxuObWBE8M75OaY_DWIEfpLfcQgD0HbN__va1KrT9e7mt9k_p5Yopsxch4fzPgBsteZCVi6gWxxKxtm1kk0 Jun 16 18:28:26.190384 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Domain-Id: None Jun 16 18:28:26.190384 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Domain-Name: None Jun 16 18:28:26.190384 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Identity-Status: Confirmed Jun 16 18:28:26.190384 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Is-Admin-Project: True Jun 16 18:28:26.190384 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Project-Domain-Id: default Jun 16 18:28:26.190384 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Project-Domain-Name: Default Jun 16 18:28:26.190384 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Project-Id: a367968c80bb4ce9973d18c1674c01b1 Jun 16 18:28:26.190384 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Project-Name: tempest-VolumesNegativeTest-1770934138 Jun 16 18:28:26.190384 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Role: reader,member Jun 16 18:28:26.190384 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Roles: reader,member Jun 16 18:28:26.193043 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a367968c80bb4ce9973d18c1674c01b1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a367968c80bb4ce9973d18c1674c01b1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_a367968c80bb4ce9973d18c1674c01b1", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/a367968c80bb4ce9973d18c1674c01b1"}]}] Jun 16 18:28:26.193043 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Tenant: tempest-VolumesNegativeTest-1770934138 Jun 16 18:28:26.193043 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Tenant-Id: a367968c80bb4ce9973d18c1674c01b1 Jun 16 18:28:26.193043 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Tenant-Name: tempest-VolumesNegativeTest-1770934138 Jun 16 18:28:26.193043 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-User: tempest-VolumesNegativeTest-1770934138-project Jun 16 18:28:26.193043 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-User-Domain-Id: default Jun 16 18:28:26.193043 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-User-Domain-Name: Default Jun 16 18:28:26.193043 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-User-Id: bc80a29a78af4201becf229b0a964fa3 Jun 16 18:28:26.193043 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-User-Name: tempest-VolumesNegativeTest-1770934138-project Jun 16 18:28:26.193043 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: method: Jun 16 18:28:26.193043 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: exception: Volume 8ce7655f-f35e-4b92-b4be-9089acd4edb4 could not be found. Jun 16 18:28:26.193043 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: action_args: {'id': '8ce7655f-f35e-4b92-b4be-9089acd4edb4'} Jun 16 18:28:26.193043 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:28:26.194571 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:28:26.194571 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 16 18:28:26.194571 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 16 18:28:26.194571 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 16 18:28:26.194571 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 16 18:28:26.194571 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 16 18:28:26.194571 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 16 18:28:26.194571 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 16 18:28:26.194571 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 16 18:28:26.194571 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 16 18:28:26.194571 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 16 18:28:26.194571 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 18:28:26.194571 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 18:28:26.194571 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 18:28:26.194571 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 18:28:26.194571 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 8ce7655f-f35e-4b92-b4be-9089acd4edb4 could not be found. (HTTP 404) (Request-ID: req-f0fd33d5-13f3-4e10-a0a1-98146d5f8d4d) Jun 16 18:28:26.194571 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi Jun 16 18:28:26.194571 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:28:26.194571 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi Jun 16 18:28:26.198306 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:28:26.198306 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 16 18:28:26.198306 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 16 18:28:26.198306 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 16 18:28:26.198306 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 16 18:28:26.198306 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 16 18:28:26.198306 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 16 18:28:26.198306 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 16 18:28:26.198306 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 16 18:28:26.198306 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 16 18:28:26.198306 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 16 18:28:26.198306 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 16 18:28:26.198306 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 16 18:28:26.198306 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 16 18:28:26.198306 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 16 18:28:26.198306 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 16 18:28:26.198306 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 16 18:28:26.198306 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 16 18:28:26.198306 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 16 18:28:26.204954 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 18:28:26.204954 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 18:28:26.204954 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 18:28:26.204954 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 18:28:26.204954 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 8ce7655f-f35e-4b92-b4be-9089acd4edb4 could not be found. Jun 16 18:28:26.204954 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi Jun 16 18:28:26.204954 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:28:26.204954 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi Jun 16 18:28:26.204954 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:28:26.204954 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:28:26.204954 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:28:26.204954 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:28:26.204954 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:28:26.204954 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 18:28:26.204954 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 18:28:26.204954 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:28:26.204954 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:28:26.204954 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 16 18:28:26.204954 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:28:26.213250 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 8ce7655f-f35e-4b92-b4be-9089acd4edb4 could not be found. Jun 16 18:28:26.213250 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi Jun 16 18:28:26.213250 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:28:26.213250 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi Jun 16 18:28:26.213250 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:28:26.213250 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:28:26.213250 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:28:26.213250 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:28:26.213250 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:28:26.213250 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 8ce7655f-f35e-4b92-b4be-9089acd4edb4 could not be found. Jun 16 18:28:26.213250 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi Jun 16 18:28:26.213250 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-228fc369-771c-43b1-85d8-2af1b4b6b87a tempest-VolumesNegativeTest-1770934138 tempest-VolumesNegativeTest-1770934138-project] Returning 404 to user: Volume 8ce7655f-f35e-4b92-b4be-9089acd4edb4 could not be found. {{(pid=117670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:28:26.213250 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-228fc369-771c-43b1-85d8-2af1b4b6b87a tempest-VolumesNegativeTest-1770934138 tempest-VolumesNegativeTest-1770934138-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/8ce7655f-f35e-4b92-b4be-9089acd4edb4" status: 404 len: 109 microversion: 2.1 time: 0.924485 Jun 16 18:28:26.226176 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 5/9] 10.222.0.30 () {58 vars in 1244 bytes} [Thu Jun 16 18:28:25 2022] GET /compute/v2.1/os-volumes/8ce7655f-f35e-4b92-b4be-9089acd4edb4 => generated 109 bytes in 941 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:28:27.733318 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-512549b5-c5c7-4f83-ac01-f2e1f4fd06cf tempest-VolumesTestJSON-2022403013 tempest-VolumesTestJSON-2022403013-project] Calling method '.version_select at 0x7fbb326dd8b0>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:28:27.890332 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-512549b5-c5c7-4f83-ac01-f2e1f4fd06cf tempest-VolumesTestJSON-2022403013 tempest-VolumesTestJSON-2022403013-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/e0a6cd53-645a-4d28-81db-447a5d9a5f79" status: 200 len: 350 microversion: 2.1 time: 0.165362 Jun 16 18:28:27.904556 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 5/10] 10.222.0.30 () {58 vars in 1244 bytes} [Thu Jun 16 18:28:27 2022] GET /compute/v2.1/os-volumes/e0a6cd53-645a-4d28-81db-447a5d9a5f79 => generated 350 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:28:30.232725 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-0a1c829b-8bd2-42c4-b354-3b5b497bd9d6 tempest-VolumesTestJSON-2022403013 tempest-VolumesTestJSON-2022403013-project] Calling method '.version_select at 0x7fbb31c3a790>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:28:30.411146 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-0a1c829b-8bd2-42c4-b354-3b5b497bd9d6 tempest-VolumesTestJSON-2022403013 tempest-VolumesTestJSON-2022403013-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/f1e5cfb5-09aa-468c-9556-36df559f84c8" status: 200 len: 351 microversion: 2.1 time: 0.183827 Jun 16 18:28:30.425987 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 6/11] 10.222.0.30 () {58 vars in 1244 bytes} [Thu Jun 16 18:28:30 2022] GET /compute/v2.1/os-volumes/f1e5cfb5-09aa-468c-9556-36df559f84c8 => generated 351 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:28:30.426220 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-e96198de-3ee9-4c17-b57a-e8a75ce65cb6 tempest-VolumesTestJSON-2022403013 tempest-VolumesTestJSON-2022403013-project] Calling method '.version_select at 0x7fbb31c8e820>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:28:30.590551 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-e96198de-3ee9-4c17-b57a-e8a75ce65cb6 tempest-VolumesTestJSON-2022403013 tempest-VolumesTestJSON-2022403013-project] 10.222.0.30 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.168641 Jun 16 18:28:30.593116 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 6/12] 10.222.0.30 () {58 vars in 1133 bytes} [Thu Jun 16 18:28:30 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:28:30.607452 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-d9abf9aa-9017-4f1e-b7ab-5ee27a5807b0 tempest-VolumesTestJSON-2022403013 tempest-VolumesTestJSON-2022403013-project] Calling method '.version_select at 0x7fbb31c8c9d0>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:28:30.786415 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-d9abf9aa-9017-4f1e-b7ab-5ee27a5807b0 tempest-VolumesTestJSON-2022403013 tempest-VolumesTestJSON-2022403013-project] 10.222.0.30 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.184649 Jun 16 18:28:30.787320 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 7/13] 10.222.0.30 () {58 vars in 1148 bytes} [Thu Jun 16 18:28:30 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:28:30.802942 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-a4da5f15-b6de-4017-b0d7-b52a31d18c18 tempest-VolumesTestJSON-2022403013 tempest-VolumesTestJSON-2022403013-project] Calling method '.version_select at 0x7fbb31c90430>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:28:31.044518 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-a4da5f15-b6de-4017-b0d7-b52a31d18c18 tempest-VolumesTestJSON-2022403013 tempest-VolumesTestJSON-2022403013-project] 10.222.0.30 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.245188 Jun 16 18:28:31.045731 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 7/14] 10.222.0.30 () {58 vars in 1133 bytes} [Thu Jun 16 18:28:30 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:28:31.061120 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-9b1b4b93-7cbb-45c9-8aa4-806cc9855e05 tempest-VolumesTestJSON-2022403013 tempest-VolumesTestJSON-2022403013-project] Calling method '.version_select at 0x7fbb31c3a940>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:28:31.205621 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-9b1b4b93-7cbb-45c9-8aa4-806cc9855e05 tempest-VolumesTestJSON-2022403013 tempest-VolumesTestJSON-2022403013-project] 10.222.0.30 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.151955 Jun 16 18:28:31.206706 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 8/15] 10.222.0.30 () {58 vars in 1166 bytes} [Thu Jun 16 18:28:31 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:28:31.221499 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-83aa703f-706e-4ada-b036-cea5317125ac tempest-VolumesTestJSON-2022403013 tempest-VolumesTestJSON-2022403013-project] Calling method '.version_select at 0x7fbb31c940d0>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:28:31.712293 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-83aa703f-706e-4ada-b036-cea5317125ac tempest-VolumesTestJSON-2022403013 tempest-VolumesTestJSON-2022403013-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.494768 Jun 16 18:28:31.714255 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 8/16] 10.222.0.30 () {58 vars in 1169 bytes} [Thu Jun 16 18:28:31 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 18:28:31.728702 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-d7bbab7c-6235-44fe-949c-b494fccacd3d tempest-VolumesTestJSON-2022403013 tempest-VolumesTestJSON-2022403013-project] Calling method '.version_select at 0x7fbb31c414c0>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:28:31.935848 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-d7bbab7c-6235-44fe-949c-b494fccacd3d tempest-VolumesTestJSON-2022403013 tempest-VolumesTestJSON-2022403013-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.212101 Jun 16 18:28:31.936515 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 9/17] 10.222.0.30 () {58 vars in 1154 bytes} [Thu Jun 16 18:28:31 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:28:31.949391 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-f3a22e50-30e0-4f7f-86b1-a2d36ee50d93 tempest-VolumesTestJSON-2022403013 tempest-VolumesTestJSON-2022403013-project] Calling method '.version_select at 0x7fbb31c8eb80>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:28:32.279733 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-f3a22e50-30e0-4f7f-86b1-a2d36ee50d93 tempest-VolumesTestJSON-2022403013 tempest-VolumesTestJSON-2022403013-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.335364 Jun 16 18:28:32.280913 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 9/18] 10.222.0.30 () {58 vars in 1187 bytes} [Thu Jun 16 18:28:31 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:28:32.294189 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-9b89deb4-11da-4014-bc7c-7cd170c52904 tempest-VolumesTestJSON-2022403013 tempest-VolumesTestJSON-2022403013-project] Calling method '.version_select at 0x7fbb31c3ac10>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:28:32.892426 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-9b89deb4-11da-4014-bc7c-7cd170c52904 tempest-VolumesTestJSON-2022403013 tempest-VolumesTestJSON-2022403013-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.603560 Jun 16 18:28:32.893963 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 10/19] 10.222.0.30 () {58 vars in 1154 bytes} [Thu Jun 16 18:28:32 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:28:40.315924 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-75944fa3-397e-49a7-a103-66d4e36a55e1 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Action: 'create', calling method: .version_select at 0x7fbb326ddb80>, body: {"keypair": {"name": "tempest-keypair-2081235105", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPa8p2FKJHIv64pWj4GxnyQ2V+faau39OaCii5rBFRNgeIvmm13jJIUfKE6bIhRKIg8KWhLT4SDi5tRUuWuJNq85C7KOFo1xOre4eY7rbtwHeRQd6Nm+BXY/OgUnzIzD6g=="}} {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:28:40.553507 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.quota [None req-75944fa3-397e-49a7-a103-66d4e36a55e1 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Getting quotas for project 1f0473c6214a4428be438fabc530012b. Resources: {'key_pairs'} {{(pid=117671) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 18:28:40.592967 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.quota [None req-75944fa3-397e-49a7-a103-66d4e36a55e1 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Getting quotas for user 89f6c755dbf74640a372802f02733eb3 and project 1f0473c6214a4428be438fabc530012b. Resources: {'key_pairs'} {{(pid=117671) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 18:28:40.880898 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-75944fa3-397e-49a7-a103-66d4e36a55e1 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 1.451503 Jun 16 18:28:40.886888 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 10/20] 10.222.0.30 () {60 vars in 1158 bytes} [Thu Jun 16 18:28:39 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 1459 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:28:45.254389 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-f1e5932a-1caf-47dc-9ec1-a666bae199d4 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Action: 'create', calling method: .version_select at 0x7fbb31e349d0>, body: {"keypair": {"name": "tempest-keypair-1465376425", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI19E9GxTK/v8cQVZoP2Qj4e9xTKeE99a5gMvabijMnMF2gbMSm1cuBAM9q2oysUrXlm/EPS8k0a8wtcVxot1aARBjgGg8e/QwnEpTQWuZkY4dGQuRtt/kjt22sXl0D7Wg=="}} {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:28:45.431973 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.quota [None req-f1e5932a-1caf-47dc-9ec1-a666bae199d4 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Getting quotas for project 7904e707e39846fdb8b7d019719dc163. Resources: {'key_pairs'} {{(pid=117670) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 18:28:45.459811 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.quota [None req-f1e5932a-1caf-47dc-9ec1-a666bae199d4 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Getting quotas for user 73dc3ab6bc6448a89b26e3e1a1b5c6e8 and project 7904e707e39846fdb8b7d019719dc163. Resources: {'key_pairs'} {{(pid=117670) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 18:28:45.490209 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-c46dc188-7969-4afa-b616-dd4b00b180fd tempest-DeleteServersTestJSON-823268338 tempest-DeleteServersTestJSON-823268338-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-559457236", "imageRef": "38ef083a-a9ff-4836-8954-f770268ba205", "flavorRef": "452", "networks": [{"uuid": "582bc60a-8c58-4bed-8088-4ab602fbe5f6"}]}} {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:28:45.647578 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-f1e5932a-1caf-47dc-9ec1-a666bae199d4 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 1.421515 Jun 16 18:28:45.649404 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 11/21] 10.222.0.30 () {62 vars in 1199 bytes} [Thu Jun 16 18:28:44 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 1424 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jun 16 18:28:45.713814 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.network.neutron [None req-c46dc188-7969-4afa-b616-dd4b00b180fd tempest-DeleteServersTestJSON-823268338 tempest-DeleteServersTestJSON-823268338-project] validate_networks() for [('582bc60a-8c58-4bed-8088-4ab602fbe5f6', None, None, None, None, None)] {{(pid=117671) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 18:28:47.177398 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-118b9675-d5f5-45c0-8af2-a41dec1ea36b tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1693895152", "imageRef": "38ef083a-a9ff-4836-8954-f770268ba205", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8dc64fea-6d01-44bc-9636-d5525e5d1ec1"}], "security_groups": [{"name": "tempest-securitygroup--1704578717"}], "key_name": "tempest-keypair-2081235105", "user_data": "}} {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:28:47.731190 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.network.neutron [None req-118b9675-d5f5-45c0-8af2-a41dec1ea36b tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] validate_networks() for [('8dc64fea-6d01-44bc-9636-d5525e5d1ec1', None, None, None, None, None)] {{(pid=117670) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 18:28:50.445111 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.virt.hardware [None req-c46dc188-7969-4afa-b616-dd4b00b180fd tempest-DeleteServersTestJSON-823268338 tempest-DeleteServersTestJSON-823268338-project] Flavor limits 0:0:0 {{(pid=117671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 18:28:50.446086 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.virt.hardware [None req-c46dc188-7969-4afa-b616-dd4b00b180fd tempest-DeleteServersTestJSON-823268338 tempest-DeleteServersTestJSON-823268338-project] Image limits 0:0:0 {{(pid=117671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 18:28:50.446086 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.virt.hardware [None req-c46dc188-7969-4afa-b616-dd4b00b180fd tempest-DeleteServersTestJSON-823268338 tempest-DeleteServersTestJSON-823268338-project] Flavor pref 0:0:0 {{(pid=117671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 18:28:50.447492 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.virt.hardware [None req-c46dc188-7969-4afa-b616-dd4b00b180fd tempest-DeleteServersTestJSON-823268338 tempest-DeleteServersTestJSON-823268338-project] Image pref 0:0:0 {{(pid=117671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 18:28:50.447492 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.virt.hardware [None req-c46dc188-7969-4afa-b616-dd4b00b180fd tempest-DeleteServersTestJSON-823268338 tempest-DeleteServersTestJSON-823268338-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 18:28:50.468483 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-c46dc188-7969-4afa-b616-dd4b00b180fd tempest-DeleteServersTestJSON-823268338 tempest-DeleteServersTestJSON-823268338-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:28:50.468950 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-c46dc188-7969-4afa-b616-dd4b00b180fd tempest-DeleteServersTestJSON-823268338 tempest-DeleteServersTestJSON-823268338-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:28:50.475178 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-c46dc188-7969-4afa-b616-dd4b00b180fd tempest-DeleteServersTestJSON-823268338 tempest-DeleteServersTestJSON-823268338-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:28:50.475700 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-c46dc188-7969-4afa-b616-dd4b00b180fd tempest-DeleteServersTestJSON-823268338 tempest-DeleteServersTestJSON-823268338-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:28:50.588708 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.virt.hardware [None req-118b9675-d5f5-45c0-8af2-a41dec1ea36b tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Flavor limits 0:0:0 {{(pid=117670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 18:28:50.590008 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.virt.hardware [None req-118b9675-d5f5-45c0-8af2-a41dec1ea36b tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Image limits 0:0:0 {{(pid=117670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 18:28:50.590423 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.virt.hardware [None req-118b9675-d5f5-45c0-8af2-a41dec1ea36b tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Flavor pref 0:0:0 {{(pid=117670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 18:28:50.590601 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.virt.hardware [None req-118b9675-d5f5-45c0-8af2-a41dec1ea36b tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Image pref 0:0:0 {{(pid=117670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 18:28:50.591029 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.virt.hardware [None req-118b9675-d5f5-45c0-8af2-a41dec1ea36b tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 18:28:50.623866 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.quota [None req-c46dc188-7969-4afa-b616-dd4b00b180fd tempest-DeleteServersTestJSON-823268338 tempest-DeleteServersTestJSON-823268338-project] Getting quotas for project aa9111175cad44b2bbc611b7ae36a991. Resources: {'instances', 'ram', 'cores'} {{(pid=117671) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 18:28:50.624115 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-118b9675-d5f5-45c0-8af2-a41dec1ea36b tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:28:50.625368 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-118b9675-d5f5-45c0-8af2-a41dec1ea36b tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:28:50.632452 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-118b9675-d5f5-45c0-8af2-a41dec1ea36b tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:28:50.633139 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-118b9675-d5f5-45c0-8af2-a41dec1ea36b tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:28:50.654024 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.quota [None req-c46dc188-7969-4afa-b616-dd4b00b180fd tempest-DeleteServersTestJSON-823268338 tempest-DeleteServersTestJSON-823268338-project] Getting quotas for user 7ee9c06c774f478db33c16b784d6b914 and project aa9111175cad44b2bbc611b7ae36a991. Resources: {'instances', 'ram', 'cores'} {{(pid=117671) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 18:28:50.717556 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-c46dc188-7969-4afa-b616-dd4b00b180fd tempest-DeleteServersTestJSON-823268338 tempest-DeleteServersTestJSON-823268338-project] Going to run 1 instances... {{(pid=117671) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 18:28:50.729809 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-c46dc188-7969-4afa-b616-dd4b00b180fd tempest-DeleteServersTestJSON-823268338 tempest-DeleteServersTestJSON-823268338-project] [instance: 58790243-9fe3-49d2-b029-40825911ddde] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='38ef083a-a9ff-4836-8954-f770268ba205',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117671) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 18:28:50.751631 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.quota [None req-118b9675-d5f5-45c0-8af2-a41dec1ea36b tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Getting quotas for project 1f0473c6214a4428be438fabc530012b. Resources: {'instances', 'ram', 'cores'} {{(pid=117670) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 18:28:50.765529 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.quota [None req-118b9675-d5f5-45c0-8af2-a41dec1ea36b tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Getting quotas for user 89f6c755dbf74640a372802f02733eb3 and project 1f0473c6214a4428be438fabc530012b. Resources: {'instances', 'ram', 'cores'} {{(pid=117670) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 18:28:50.809889 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-118b9675-d5f5-45c0-8af2-a41dec1ea36b tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Going to run 1 instances... {{(pid=117670) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 18:28:50.836675 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-118b9675-d5f5-45c0-8af2-a41dec1ea36b tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] [instance: 121f052a-2d96-444d-a817-38e348aaf0e5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='38ef083a-a9ff-4836-8954-f770268ba205',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117670) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 18:28:51.037450 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-c46dc188-7969-4afa-b616-dd4b00b180fd tempest-DeleteServersTestJSON-823268338 tempest-DeleteServersTestJSON-823268338-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 6.301176 Jun 16 18:28:51.053024 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 11/22] 10.222.0.30 () {60 vars in 1146 bytes} [Thu Jun 16 18:28:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 6318 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 16 18:28:51.242811 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-118b9675-d5f5-45c0-8af2-a41dec1ea36b tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 4.073165 Jun 16 18:28:51.244317 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 12/23] 10.222.0.30 () {60 vars in 1146 bytes} [Thu Jun 16 18:28:47 2022] POST /compute/v2.1/servers => generated 402 bytes in 4076 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 18:28:51.258290 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-deef95e1-7228-4b46-b97f-e5897fbd7da3 tempest-DeleteServersTestJSON-823268338 tempest-DeleteServersTestJSON-823268338-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:28:51.273047 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-deef95e1-7228-4b46-b97f-e5897fbd7da3 tempest-DeleteServersTestJSON-823268338 tempest-DeleteServersTestJSON-823268338-project] [instance: 58790243-9fe3-49d2-b029-40825911ddde] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:28:51.734040 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-deef95e1-7228-4b46-b97f-e5897fbd7da3 tempest-DeleteServersTestJSON-823268338 tempest-DeleteServersTestJSON-823268338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee9c06c774f478db33c16b784d6b914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa9111175cad44b2bbc611b7ae36a991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:28:51.769690 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-deef95e1-7228-4b46-b97f-e5897fbd7da3 tempest-DeleteServersTestJSON-823268338 tempest-DeleteServersTestJSON-823268338-project] 10.222.0.30 "GET /compute/v2.1/servers/58790243-9fe3-49d2-b029-40825911ddde" status: 200 len: 1214 microversion: 2.1 time: 0.522827 Jun 16 18:28:51.784308 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 13/24] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:28:51 2022] GET /compute/v2.1/servers/58790243-9fe3-49d2-b029-40825911ddde => generated 1214 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:28:51.797562 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-0d5775cb-e9d3-4529-8ec5-33e25dc64a52 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:28:51.801617 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-0d5775cb-e9d3-4529-8ec5-33e25dc64a52 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] [instance: 121f052a-2d96-444d-a817-38e348aaf0e5] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:28:51.959845 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-779e39ff-4e66-493a-8bc4-391f8065d7a9 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-228704044", "imageRef": "38ef083a-a9ff-4836-8954-f770268ba205", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:28:51.983476 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-0d5775cb-e9d3-4529-8ec5-33e25dc64a52 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f6c755dbf74640a372802f02733eb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f0473c6214a4428be438fabc530012b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:28:52.008240 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-0d5775cb-e9d3-4529-8ec5-33e25dc64a52 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] 10.222.0.30 "GET /compute/v2.1/servers/121f052a-2d96-444d-a817-38e348aaf0e5" status: 200 len: 1242 microversion: 2.1 time: 0.220884 Jun 16 18:28:52.010757 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 14/25] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:28:51 2022] GET /compute/v2.1/servers/121f052a-2d96-444d-a817-38e348aaf0e5 => generated 1242 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:28:52.159208 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.network.neutron [None req-779e39ff-4e66-493a-8bc4-391f8065d7a9 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] validate_networks() for [('15279682-d7de-41a6-80bc-29c22a949874', None, None, None, None, None)] {{(pid=117671) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 18:28:52.526279 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-b2bad805-5486-4207-bc19-e3a53b8246ce tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1187979515", "imageRef": "38ef083a-a9ff-4836-8954-f770268ba205", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "cdfdfccf-e3dc-489b-8eaf-0509b174579d"}], "security_groups": [{"name": "tempest-securitygroup--281742109"}], "key_name": "tempest-keypair-1465376425", "user_data": "}} {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:28:52.857838 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.network.neutron [None req-b2bad805-5486-4207-bc19-e3a53b8246ce tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] validate_networks() for [('cdfdfccf-e3dc-489b-8eaf-0509b174579d', None, None, None, None, None)] {{(pid=117670) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 18:28:54.262485 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.virt.hardware [None req-779e39ff-4e66-493a-8bc4-391f8065d7a9 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Flavor limits 0:0:0 {{(pid=117671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 18:28:54.263345 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.virt.hardware [None req-779e39ff-4e66-493a-8bc4-391f8065d7a9 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Image limits 0:0:0 {{(pid=117671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 18:28:54.263591 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.virt.hardware [None req-779e39ff-4e66-493a-8bc4-391f8065d7a9 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Flavor pref 0:0:0 {{(pid=117671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 18:28:54.263987 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.virt.hardware [None req-779e39ff-4e66-493a-8bc4-391f8065d7a9 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Image pref 0:0:0 {{(pid=117671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 18:28:54.275231 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.virt.hardware [None req-779e39ff-4e66-493a-8bc4-391f8065d7a9 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 18:28:54.303166 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-779e39ff-4e66-493a-8bc4-391f8065d7a9 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:28:54.305863 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-779e39ff-4e66-493a-8bc4-391f8065d7a9 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:28:54.308986 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-779e39ff-4e66-493a-8bc4-391f8065d7a9 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:28:54.309553 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-779e39ff-4e66-493a-8bc4-391f8065d7a9 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:28:54.391140 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.quota [None req-779e39ff-4e66-493a-8bc4-391f8065d7a9 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Getting quotas for project b70bbccf07e3404cb94ba59201061a6a. Resources: {'instances', 'ram', 'cores'} {{(pid=117671) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 18:28:54.403495 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.quota [None req-779e39ff-4e66-493a-8bc4-391f8065d7a9 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Getting quotas for user 512f01cca14b447c8f6c9eebbd828eb2 and project b70bbccf07e3404cb94ba59201061a6a. Resources: {'instances', 'ram', 'cores'} {{(pid=117671) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 18:28:54.452560 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-779e39ff-4e66-493a-8bc4-391f8065d7a9 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Going to run 1 instances... {{(pid=117671) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 18:28:54.459168 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-779e39ff-4e66-493a-8bc4-391f8065d7a9 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] [instance: e541a8c3-c14c-46db-8b18-23fff07aa1d2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='38ef083a-a9ff-4836-8954-f770268ba205',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117671) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 18:28:54.576003 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.virt.hardware [None req-b2bad805-5486-4207-bc19-e3a53b8246ce tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Flavor limits 0:0:0 {{(pid=117670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 18:28:54.576899 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.virt.hardware [None req-b2bad805-5486-4207-bc19-e3a53b8246ce tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Image limits 0:0:0 {{(pid=117670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 18:28:54.577062 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.virt.hardware [None req-b2bad805-5486-4207-bc19-e3a53b8246ce tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Flavor pref 0:0:0 {{(pid=117670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 18:28:54.577556 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.virt.hardware [None req-b2bad805-5486-4207-bc19-e3a53b8246ce tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Image pref 0:0:0 {{(pid=117670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 18:28:54.578055 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.virt.hardware [None req-b2bad805-5486-4207-bc19-e3a53b8246ce tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 18:28:54.593697 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-779e39ff-4e66-493a-8bc4-391f8065d7a9 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.537899 Jun 16 18:28:54.596878 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 12/26] 10.222.0.30 () {60 vars in 1146 bytes} [Thu Jun 16 18:28:51 2022] POST /compute/v2.1/servers => generated 383 bytes in 3543 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 18:28:54.599303 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-b2bad805-5486-4207-bc19-e3a53b8246ce tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:28:54.599850 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-b2bad805-5486-4207-bc19-e3a53b8246ce tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:28:54.600628 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-b2bad805-5486-4207-bc19-e3a53b8246ce tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:28:54.601077 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-b2bad805-5486-4207-bc19-e3a53b8246ce tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:28:54.611964 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-636fb6c9-b5ad-4f15-a7f0-21f57839948b tempest-DeleteServersTestJSON-823268338 tempest-DeleteServersTestJSON-823268338-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:28:54.615208 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-636fb6c9-b5ad-4f15-a7f0-21f57839948b tempest-DeleteServersTestJSON-823268338 tempest-DeleteServersTestJSON-823268338-project] [instance: 58790243-9fe3-49d2-b029-40825911ddde] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:28:54.680576 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.quota [None req-b2bad805-5486-4207-bc19-e3a53b8246ce tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Getting quotas for project 7904e707e39846fdb8b7d019719dc163. Resources: {'instances', 'ram', 'cores'} {{(pid=117670) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 18:28:54.723817 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.quota [None req-b2bad805-5486-4207-bc19-e3a53b8246ce tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Getting quotas for user 73dc3ab6bc6448a89b26e3e1a1b5c6e8 and project 7904e707e39846fdb8b7d019719dc163. Resources: {'instances', 'ram', 'cores'} {{(pid=117670) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 18:28:54.749017 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-636fb6c9-b5ad-4f15-a7f0-21f57839948b tempest-DeleteServersTestJSON-823268338 tempest-DeleteServersTestJSON-823268338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee9c06c774f478db33c16b784d6b914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa9111175cad44b2bbc611b7ae36a991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:28:54.788988 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-636fb6c9-b5ad-4f15-a7f0-21f57839948b tempest-DeleteServersTestJSON-823268338 tempest-DeleteServersTestJSON-823268338-project] 10.222.0.30 "GET /compute/v2.1/servers/58790243-9fe3-49d2-b029-40825911ddde" status: 200 len: 1214 microversion: 2.1 time: 0.187507 Jun 16 18:28:54.801752 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-b2bad805-5486-4207-bc19-e3a53b8246ce tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Going to run 1 instances... {{(pid=117670) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 18:28:54.802427 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 13/27] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:28:54 2022] GET /compute/v2.1/servers/58790243-9fe3-49d2-b029-40825911ddde => generated 1214 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:28:54.807641 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-b2bad805-5486-4207-bc19-e3a53b8246ce tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] [instance: 651b5fe1-0df7-4bc6-b18e-7caea544a93f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='38ef083a-a9ff-4836-8954-f770268ba205',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117670) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 18:28:54.839977 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-ca0197f0-8465-4d66-8b50-91e5af04e933 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:28:54.843289 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-ca0197f0-8465-4d66-8b50-91e5af04e933 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] [instance: 121f052a-2d96-444d-a817-38e348aaf0e5] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:28:54.876707 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-ca0197f0-8465-4d66-8b50-91e5af04e933 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:28:54.879596 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-ca0197f0-8465-4d66-8b50-91e5af04e933 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:28:54.884483 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-ca0197f0-8465-4d66-8b50-91e5af04e933 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:28:54.887291 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-ca0197f0-8465-4d66-8b50-91e5af04e933 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:28:54.954810 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-b2bad805-5486-4207-bc19-e3a53b8246ce tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 2.431215 Jun 16 18:28:54.970020 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 15/28] 10.222.0.30 () {62 vars in 1187 bytes} [Thu Jun 16 18:28:52 2022] POST /compute/v2.1/servers => generated 401 bytes in 2448 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 16 18:28:54.989263 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-7973a42b-2110-4c62-a2d2-edf9f9e6d0e6 tempest-VolumesNegativeTest-992612787 tempest-VolumesNegativeTest-992612787-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1476666717", "imageRef": "38ef083a-a9ff-4836-8954-f770268ba205", "flavorRef": "452"}} {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:28:55.132251 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.network.neutron [None req-7973a42b-2110-4c62-a2d2-edf9f9e6d0e6 tempest-VolumesNegativeTest-992612787 tempest-VolumesNegativeTest-992612787-project] validate_networks() for None {{(pid=117670) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 18:28:55.697534 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-ca0197f0-8465-4d66-8b50-91e5af04e933 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f6c755dbf74640a372802f02733eb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f0473c6214a4428be438fabc530012b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:28:55.727576 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-ca0197f0-8465-4d66-8b50-91e5af04e933 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] 10.222.0.30 "GET /compute/v2.1/servers/121f052a-2d96-444d-a817-38e348aaf0e5" status: 200 len: 1246 microversion: 2.1 time: 0.902638 Jun 16 18:28:55.738412 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 14/29] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:28:54 2022] GET /compute/v2.1/servers/121f052a-2d96-444d-a817-38e348aaf0e5 => generated 1246 bytes in 935 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:28:55.770319 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-9004c4e6-747c-4c43-87e6-8049bbc1ac56 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:28:55.770960 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-9004c4e6-747c-4c43-87e6-8049bbc1ac56 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] [instance: e541a8c3-c14c-46db-8b18-23fff07aa1d2] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:28:55.990631 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-9004c4e6-747c-4c43-87e6-8049bbc1ac56 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512f01cca14b447c8f6c9eebbd828eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70bbccf07e3404cb94ba59201061a6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:28:56.009784 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-9004c4e6-747c-4c43-87e6-8049bbc1ac56 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] 10.222.0.30 "GET /compute/v2.1/servers/e541a8c3-c14c-46db-8b18-23fff07aa1d2" status: 200 len: 1221 microversion: 2.1 time: 0.269644 Jun 16 18:28:56.010889 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 15/30] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:28:55 2022] GET /compute/v2.1/servers/e541a8c3-c14c-46db-8b18-23fff07aa1d2 => generated 1221 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:28:56.029213 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-80bc3668-2015-42c4-977a-4d29b6d6e4c2 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:28:56.030221 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-80bc3668-2015-42c4-977a-4d29b6d6e4c2 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] [instance: 651b5fe1-0df7-4bc6-b18e-7caea544a93f] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:28:56.261414 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-80bc3668-2015-42c4-977a-4d29b6d6e4c2 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:28:56.285760 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-80bc3668-2015-42c4-977a-4d29b6d6e4c2 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:28:56.299036 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-80bc3668-2015-42c4-977a-4d29b6d6e4c2 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:28:56.303501 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-80bc3668-2015-42c4-977a-4d29b6d6e4c2 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] 10.222.0.30 "GET /compute/v2.1/servers/651b5fe1-0df7-4bc6-b18e-7caea544a93f" status: 200 len: 1282 microversion: 2.20 time: 0.284073 Jun 16 18:28:56.307770 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 16/31] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Jun 16 18:28:56 2022] GET /compute/v2.1/servers/651b5fe1-0df7-4bc6-b18e-7caea544a93f => generated 1282 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:28:56.323418 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-f40be962-c853-4b96-9ec0-f7e7bce4abf9 tempest-DeleteServersTestJSON-823268338 tempest-DeleteServersTestJSON-823268338-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:28:56.332940 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-f40be962-c853-4b96-9ec0-f7e7bce4abf9 tempest-DeleteServersTestJSON-823268338 tempest-DeleteServersTestJSON-823268338-project] [instance: 58790243-9fe3-49d2-b029-40825911ddde] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:28:56.358749 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-f40be962-c853-4b96-9ec0-f7e7bce4abf9 tempest-DeleteServersTestJSON-823268338 tempest-DeleteServersTestJSON-823268338-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:28:56.361372 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-f40be962-c853-4b96-9ec0-f7e7bce4abf9 tempest-DeleteServersTestJSON-823268338 tempest-DeleteServersTestJSON-823268338-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:28:56.368337 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-f40be962-c853-4b96-9ec0-f7e7bce4abf9 tempest-DeleteServersTestJSON-823268338 tempest-DeleteServersTestJSON-823268338-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:28:56.369615 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-f40be962-c853-4b96-9ec0-f7e7bce4abf9 tempest-DeleteServersTestJSON-823268338 tempest-DeleteServersTestJSON-823268338-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:28:56.696596 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-f40be962-c853-4b96-9ec0-f7e7bce4abf9 tempest-DeleteServersTestJSON-823268338 tempest-DeleteServersTestJSON-823268338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee9c06c774f478db33c16b784d6b914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa9111175cad44b2bbc611b7ae36a991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:28:56.710650 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-f40be962-c853-4b96-9ec0-f7e7bce4abf9 tempest-DeleteServersTestJSON-823268338 tempest-DeleteServersTestJSON-823268338-project] 10.222.0.30 "GET /compute/v2.1/servers/58790243-9fe3-49d2-b029-40825911ddde" status: 200 len: 1266 microversion: 2.1 time: 0.400590 Jun 16 18:28:56.717018 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 17/32] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:28:56 2022] GET /compute/v2.1/servers/58790243-9fe3-49d2-b029-40825911ddde => generated 1266 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:28:56.761147 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-8ddcb088-ce5b-4e42-9a2f-7798532fe566 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:28:56.765629 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-8ddcb088-ce5b-4e42-9a2f-7798532fe566 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] [instance: 121f052a-2d96-444d-a817-38e348aaf0e5] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:28:56.789067 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-8ddcb088-ce5b-4e42-9a2f-7798532fe566 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:28:56.789528 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-8ddcb088-ce5b-4e42-9a2f-7798532fe566 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:28:56.795597 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-8ddcb088-ce5b-4e42-9a2f-7798532fe566 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:28:56.796178 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-8ddcb088-ce5b-4e42-9a2f-7798532fe566 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:28:57.061312 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.virt.hardware [None req-7973a42b-2110-4c62-a2d2-edf9f9e6d0e6 tempest-VolumesNegativeTest-992612787 tempest-VolumesNegativeTest-992612787-project] Flavor limits 0:0:0 {{(pid=117670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 18:28:57.062976 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.virt.hardware [None req-7973a42b-2110-4c62-a2d2-edf9f9e6d0e6 tempest-VolumesNegativeTest-992612787 tempest-VolumesNegativeTest-992612787-project] Image limits 0:0:0 {{(pid=117670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 18:28:57.063623 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.virt.hardware [None req-7973a42b-2110-4c62-a2d2-edf9f9e6d0e6 tempest-VolumesNegativeTest-992612787 tempest-VolumesNegativeTest-992612787-project] Flavor pref 0:0:0 {{(pid=117670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 18:28:57.064451 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.virt.hardware [None req-7973a42b-2110-4c62-a2d2-edf9f9e6d0e6 tempest-VolumesNegativeTest-992612787 tempest-VolumesNegativeTest-992612787-project] Image pref 0:0:0 {{(pid=117670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 18:28:57.065737 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.virt.hardware [None req-7973a42b-2110-4c62-a2d2-edf9f9e6d0e6 tempest-VolumesNegativeTest-992612787 tempest-VolumesNegativeTest-992612787-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 18:28:57.101291 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-7973a42b-2110-4c62-a2d2-edf9f9e6d0e6 tempest-VolumesNegativeTest-992612787 tempest-VolumesNegativeTest-992612787-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:28:57.101956 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-7973a42b-2110-4c62-a2d2-edf9f9e6d0e6 tempest-VolumesNegativeTest-992612787 tempest-VolumesNegativeTest-992612787-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:28:57.103116 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-7973a42b-2110-4c62-a2d2-edf9f9e6d0e6 tempest-VolumesNegativeTest-992612787 tempest-VolumesNegativeTest-992612787-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:28:57.103723 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-7973a42b-2110-4c62-a2d2-edf9f9e6d0e6 tempest-VolumesNegativeTest-992612787 tempest-VolumesNegativeTest-992612787-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:28:57.136676 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-8ddcb088-ce5b-4e42-9a2f-7798532fe566 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f6c755dbf74640a372802f02733eb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f0473c6214a4428be438fabc530012b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:28:57.170665 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-8ddcb088-ce5b-4e42-9a2f-7798532fe566 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] 10.222.0.30 "GET /compute/v2.1/servers/121f052a-2d96-444d-a817-38e348aaf0e5" status: 200 len: 1294 microversion: 2.1 time: 0.421476 Jun 16 18:28:57.175898 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 18/33] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:28:56 2022] GET /compute/v2.1/servers/121f052a-2d96-444d-a817-38e348aaf0e5 => generated 1294 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:28:57.195543 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-b0140afb-ce09-463d-bf5a-e0c8f8de2c53 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1277807625", "imageRef": "38ef083a-a9ff-4836-8954-f770268ba205", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:28:57.214000 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.quota [None req-7973a42b-2110-4c62-a2d2-edf9f9e6d0e6 tempest-VolumesNegativeTest-992612787 tempest-VolumesNegativeTest-992612787-project] Getting quotas for project 478dbeee61b6401c9dbb31c216ce537b. Resources: {'instances', 'ram', 'cores'} {{(pid=117670) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 18:28:57.227189 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.quota [None req-7973a42b-2110-4c62-a2d2-edf9f9e6d0e6 tempest-VolumesNegativeTest-992612787 tempest-VolumesNegativeTest-992612787-project] Getting quotas for user 479bda47e66544e8bfa47dad8294c180 and project 478dbeee61b6401c9dbb31c216ce537b. Resources: {'instances', 'ram', 'cores'} {{(pid=117670) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 18:28:57.296576 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-7973a42b-2110-4c62-a2d2-edf9f9e6d0e6 tempest-VolumesNegativeTest-992612787 tempest-VolumesNegativeTest-992612787-project] Going to run 1 instances... {{(pid=117670) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 18:28:57.299145 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-7973a42b-2110-4c62-a2d2-edf9f9e6d0e6 tempest-VolumesNegativeTest-992612787 tempest-VolumesNegativeTest-992612787-project] [instance: b626d1e4-c5fd-47aa-be1f-4dbd8c2d50b5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='38ef083a-a9ff-4836-8954-f770268ba205',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117670) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 18:28:57.484301 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-7973a42b-2110-4c62-a2d2-edf9f9e6d0e6 tempest-VolumesNegativeTest-992612787 tempest-VolumesNegativeTest-992612787-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.509903 Jun 16 18:28:57.485660 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 16/34] 10.222.0.30 () {60 vars in 1146 bytes} [Thu Jun 16 18:28:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 2514 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 18:28:57.490908 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.network.neutron [None req-b0140afb-ce09-463d-bf5a-e0c8f8de2c53 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] validate_networks() for [('15279682-d7de-41a6-80bc-29c22a949874', None, None, None, None, None)] {{(pid=117671) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 18:28:57.499138 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-625cf59b-2a4e-4c4e-8bc0-5edb84fc3031 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:28:57.510714 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-625cf59b-2a4e-4c4e-8bc0-5edb84fc3031 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] [instance: 651b5fe1-0df7-4bc6-b18e-7caea544a93f] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:28:57.522967 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-625cf59b-2a4e-4c4e-8bc0-5edb84fc3031 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:28:57.523738 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-625cf59b-2a4e-4c4e-8bc0-5edb84fc3031 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:28:57.524929 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-625cf59b-2a4e-4c4e-8bc0-5edb84fc3031 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:28:57.525606 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-625cf59b-2a4e-4c4e-8bc0-5edb84fc3031 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:28:57.910710 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-625cf59b-2a4e-4c4e-8bc0-5edb84fc3031 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:28:57.929005 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-625cf59b-2a4e-4c4e-8bc0-5edb84fc3031 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:28:57.931051 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-625cf59b-2a4e-4c4e-8bc0-5edb84fc3031 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:28:57.933936 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-625cf59b-2a4e-4c4e-8bc0-5edb84fc3031 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] 10.222.0.30 "GET /compute/v2.1/servers/651b5fe1-0df7-4bc6-b18e-7caea544a93f" status: 200 len: 1286 microversion: 2.20 time: 0.446809 Jun 16 18:28:57.935548 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 17/35] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Jun 16 18:28:57 2022] GET /compute/v2.1/servers/651b5fe1-0df7-4bc6-b18e-7caea544a93f => generated 1286 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:28:57.958453 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-1d1e78bf-9acd-4858-8a62-f589868f420b tempest-VolumesNegativeTest-992612787 tempest-VolumesNegativeTest-992612787-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:28:57.959457 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-1d1e78bf-9acd-4858-8a62-f589868f420b tempest-VolumesNegativeTest-992612787 tempest-VolumesNegativeTest-992612787-project] [instance: b626d1e4-c5fd-47aa-be1f-4dbd8c2d50b5] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:28:58.116491 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-1d1e78bf-9acd-4858-8a62-f589868f420b tempest-VolumesNegativeTest-992612787 tempest-VolumesNegativeTest-992612787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '479bda47e66544e8bfa47dad8294c180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '478dbeee61b6401c9dbb31c216ce537b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:28:58.133591 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-1d1e78bf-9acd-4858-8a62-f589868f420b tempest-VolumesNegativeTest-992612787 tempest-VolumesNegativeTest-992612787-project] 10.222.0.30 "GET /compute/v2.1/servers/b626d1e4-c5fd-47aa-be1f-4dbd8c2d50b5" status: 200 len: 1215 microversion: 2.1 time: 0.195358 Jun 16 18:28:58.136661 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 18/36] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:28:57 2022] GET /compute/v2.1/servers/b626d1e4-c5fd-47aa-be1f-4dbd8c2d50b5 => generated 1215 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:28:58.164671 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-879eca79-139e-40bb-89dd-d96b0eef34c8 tempest-DeleteServersTestJSON-823268338 tempest-DeleteServersTestJSON-823268338-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:28:58.181082 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-879eca79-139e-40bb-89dd-d96b0eef34c8 tempest-DeleteServersTestJSON-823268338 tempest-DeleteServersTestJSON-823268338-project] [instance: 58790243-9fe3-49d2-b029-40825911ddde] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:28:58.213006 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-879eca79-139e-40bb-89dd-d96b0eef34c8 tempest-DeleteServersTestJSON-823268338 tempest-DeleteServersTestJSON-823268338-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:28:58.217206 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-879eca79-139e-40bb-89dd-d96b0eef34c8 tempest-DeleteServersTestJSON-823268338 tempest-DeleteServersTestJSON-823268338-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:28:58.219550 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-879eca79-139e-40bb-89dd-d96b0eef34c8 tempest-DeleteServersTestJSON-823268338 tempest-DeleteServersTestJSON-823268338-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:28:58.220155 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-879eca79-139e-40bb-89dd-d96b0eef34c8 tempest-DeleteServersTestJSON-823268338 tempest-DeleteServersTestJSON-823268338-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:28:58.476552 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-879eca79-139e-40bb-89dd-d96b0eef34c8 tempest-DeleteServersTestJSON-823268338 tempest-DeleteServersTestJSON-823268338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee9c06c774f478db33c16b784d6b914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa9111175cad44b2bbc611b7ae36a991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:28:58.502092 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-879eca79-139e-40bb-89dd-d96b0eef34c8 tempest-DeleteServersTestJSON-823268338 tempest-DeleteServersTestJSON-823268338-project] 10.222.0.30 "GET /compute/v2.1/servers/58790243-9fe3-49d2-b029-40825911ddde" status: 200 len: 1274 microversion: 2.1 time: 0.363503 Jun 16 18:28:58.519320 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 19/37] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:28:58 2022] GET /compute/v2.1/servers/58790243-9fe3-49d2-b029-40825911ddde => generated 1274 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:28:58.533374 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-a59518dd-0d53-4e2b-897f-af010fba909a tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:28:58.535865 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-a59518dd-0d53-4e2b-897f-af010fba909a tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] [instance: 121f052a-2d96-444d-a817-38e348aaf0e5] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:28:58.559376 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-a59518dd-0d53-4e2b-897f-af010fba909a tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:28:58.561383 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-a59518dd-0d53-4e2b-897f-af010fba909a tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:28:58.562504 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-a59518dd-0d53-4e2b-897f-af010fba909a tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:28:58.564364 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-a59518dd-0d53-4e2b-897f-af010fba909a tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:28:58.784533 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-a59518dd-0d53-4e2b-897f-af010fba909a tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f6c755dbf74640a372802f02733eb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f0473c6214a4428be438fabc530012b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:28:58.804164 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-a59518dd-0d53-4e2b-897f-af010fba909a tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] 10.222.0.30 "GET /compute/v2.1/servers/121f052a-2d96-444d-a817-38e348aaf0e5" status: 200 len: 1302 microversion: 2.1 time: 0.281941 Jun 16 18:28:58.804789 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 20/38] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:28:58 2022] GET /compute/v2.1/servers/121f052a-2d96-444d-a817-38e348aaf0e5 => generated 1302 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:28:58.914134 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.virt.hardware [None req-b0140afb-ce09-463d-bf5a-e0c8f8de2c53 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Flavor limits 0:0:0 {{(pid=117671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 18:28:58.915181 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.virt.hardware [None req-b0140afb-ce09-463d-bf5a-e0c8f8de2c53 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Image limits 0:0:0 {{(pid=117671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 18:28:58.916388 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.virt.hardware [None req-b0140afb-ce09-463d-bf5a-e0c8f8de2c53 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Flavor pref 0:0:0 {{(pid=117671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 18:28:58.918647 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.virt.hardware [None req-b0140afb-ce09-463d-bf5a-e0c8f8de2c53 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Image pref 0:0:0 {{(pid=117671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 18:28:58.919249 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.virt.hardware [None req-b0140afb-ce09-463d-bf5a-e0c8f8de2c53 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 18:28:58.936625 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-b0140afb-ce09-463d-bf5a-e0c8f8de2c53 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:28:58.937880 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-b0140afb-ce09-463d-bf5a-e0c8f8de2c53 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:28:58.939963 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-b0140afb-ce09-463d-bf5a-e0c8f8de2c53 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:28:58.941056 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-b0140afb-ce09-463d-bf5a-e0c8f8de2c53 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:28:58.972680 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-daf4440c-cd5d-4b85-a9ec-7dbc1a106473 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:28:58.973936 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-daf4440c-cd5d-4b85-a9ec-7dbc1a106473 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] [instance: 651b5fe1-0df7-4bc6-b18e-7caea544a93f] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:28:58.979620 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.quota [None req-b0140afb-ce09-463d-bf5a-e0c8f8de2c53 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Getting quotas for project b70bbccf07e3404cb94ba59201061a6a. Resources: {'instances', 'ram', 'cores'} {{(pid=117671) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 18:28:58.988738 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.quota [None req-b0140afb-ce09-463d-bf5a-e0c8f8de2c53 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Getting quotas for user 512f01cca14b447c8f6c9eebbd828eb2 and project b70bbccf07e3404cb94ba59201061a6a. Resources: {'instances', 'ram', 'cores'} {{(pid=117671) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 18:28:58.990692 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-daf4440c-cd5d-4b85-a9ec-7dbc1a106473 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:28:58.992978 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-daf4440c-cd5d-4b85-a9ec-7dbc1a106473 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:28:58.995986 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-daf4440c-cd5d-4b85-a9ec-7dbc1a106473 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:28:59.006887 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-daf4440c-cd5d-4b85-a9ec-7dbc1a106473 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:28:59.016504 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-b0140afb-ce09-463d-bf5a-e0c8f8de2c53 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Going to run 1 instances... {{(pid=117671) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 18:28:59.021401 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-b0140afb-ce09-463d-bf5a-e0c8f8de2c53 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] [instance: 05981bed-b625-4e9a-b860-6a7ce1288e8d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='38ef083a-a9ff-4836-8954-f770268ba205',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117671) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 18:28:59.137530 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-b0140afb-ce09-463d-bf5a-e0c8f8de2c53 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.959225 Jun 16 18:28:59.138574 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 19/39] 10.222.0.30 () {60 vars in 1146 bytes} [Thu Jun 16 18:28:57 2022] POST /compute/v2.1/servers => generated 383 bytes in 1962 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 18:28:59.157619 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-0187e0af-ec59-4817-baaf-55d356377fad tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:28:59.158716 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-0187e0af-ec59-4817-baaf-55d356377fad tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] [instance: 05981bed-b625-4e9a-b860-6a7ce1288e8d] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:28:59.175086 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-daf4440c-cd5d-4b85-a9ec-7dbc1a106473 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:28:59.184886 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-daf4440c-cd5d-4b85-a9ec-7dbc1a106473 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:28:59.186615 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-daf4440c-cd5d-4b85-a9ec-7dbc1a106473 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:28:59.187795 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-daf4440c-cd5d-4b85-a9ec-7dbc1a106473 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] 10.222.0.30 "GET /compute/v2.1/servers/651b5fe1-0df7-4bc6-b18e-7caea544a93f" status: 200 len: 1278 microversion: 2.20 time: 0.226024 Jun 16 18:28:59.188413 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 21/40] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Jun 16 18:28:58 2022] GET /compute/v2.1/servers/651b5fe1-0df7-4bc6-b18e-7caea544a93f => generated 1278 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 18:28:59.203498 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-a4d78579-5d79-4a4f-a3b9-bafd9109cf2b tempest-VolumesNegativeTest-992612787 tempest-VolumesNegativeTest-992612787-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:28:59.204616 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-a4d78579-5d79-4a4f-a3b9-bafd9109cf2b tempest-VolumesNegativeTest-992612787 tempest-VolumesNegativeTest-992612787-project] [instance: b626d1e4-c5fd-47aa-be1f-4dbd8c2d50b5] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:28:59.221795 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-a4d78579-5d79-4a4f-a3b9-bafd9109cf2b tempest-VolumesNegativeTest-992612787 tempest-VolumesNegativeTest-992612787-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:28:59.222520 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-a4d78579-5d79-4a4f-a3b9-bafd9109cf2b tempest-VolumesNegativeTest-992612787 tempest-VolumesNegativeTest-992612787-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:28:59.223458 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-a4d78579-5d79-4a4f-a3b9-bafd9109cf2b tempest-VolumesNegativeTest-992612787 tempest-VolumesNegativeTest-992612787-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:28:59.223963 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-a4d78579-5d79-4a4f-a3b9-bafd9109cf2b tempest-VolumesNegativeTest-992612787 tempest-VolumesNegativeTest-992612787-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:28:59.263577 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-0187e0af-ec59-4817-baaf-55d356377fad tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512f01cca14b447c8f6c9eebbd828eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70bbccf07e3404cb94ba59201061a6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:28:59.278944 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-0187e0af-ec59-4817-baaf-55d356377fad tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] 10.222.0.30 "GET /compute/v2.1/servers/05981bed-b625-4e9a-b860-6a7ce1288e8d" status: 200 len: 1222 microversion: 2.1 time: 0.126946 Jun 16 18:28:59.281559 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 20/41] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:28:59 2022] GET /compute/v2.1/servers/05981bed-b625-4e9a-b860-6a7ce1288e8d => generated 1222 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:28:59.313046 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-a4d78579-5d79-4a4f-a3b9-bafd9109cf2b tempest-VolumesNegativeTest-992612787 tempest-VolumesNegativeTest-992612787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '479bda47e66544e8bfa47dad8294c180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '478dbeee61b6401c9dbb31c216ce537b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:28:59.322363 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-a4d78579-5d79-4a4f-a3b9-bafd9109cf2b tempest-VolumesNegativeTest-992612787 tempest-VolumesNegativeTest-992612787-project] 10.222.0.30 "GET /compute/v2.1/servers/b626d1e4-c5fd-47aa-be1f-4dbd8c2d50b5" status: 200 len: 1219 microversion: 2.1 time: 0.130928 Jun 16 18:28:59.323818 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 22/42] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:28:59 2022] GET /compute/v2.1/servers/b626d1e4-c5fd-47aa-be1f-4dbd8c2d50b5 => generated 1219 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:28:59.524686 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-1437b53c-6bdd-4340-9a8b-3fde0a2507ce tempest-DeleteServersTestJSON-823268338 tempest-DeleteServersTestJSON-823268338-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:28:59.525386 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-1437b53c-6bdd-4340-9a8b-3fde0a2507ce tempest-DeleteServersTestJSON-823268338 tempest-DeleteServersTestJSON-823268338-project] [instance: 58790243-9fe3-49d2-b029-40825911ddde] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:28:59.533913 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-1437b53c-6bdd-4340-9a8b-3fde0a2507ce tempest-DeleteServersTestJSON-823268338 tempest-DeleteServersTestJSON-823268338-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:28:59.534642 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-1437b53c-6bdd-4340-9a8b-3fde0a2507ce tempest-DeleteServersTestJSON-823268338 tempest-DeleteServersTestJSON-823268338-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:28:59.535510 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-1437b53c-6bdd-4340-9a8b-3fde0a2507ce tempest-DeleteServersTestJSON-823268338 tempest-DeleteServersTestJSON-823268338-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:28:59.535981 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-1437b53c-6bdd-4340-9a8b-3fde0a2507ce tempest-DeleteServersTestJSON-823268338 tempest-DeleteServersTestJSON-823268338-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:28:59.822272 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-23155758-9eb7-41b4-bd38-44989f6449b5 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:28:59.823275 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-23155758-9eb7-41b4-bd38-44989f6449b5 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] [instance: 121f052a-2d96-444d-a817-38e348aaf0e5] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:28:59.849076 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-23155758-9eb7-41b4-bd38-44989f6449b5 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:28:59.851045 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-23155758-9eb7-41b4-bd38-44989f6449b5 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:28:59.855482 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-23155758-9eb7-41b4-bd38-44989f6449b5 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:28:59.856078 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-23155758-9eb7-41b4-bd38-44989f6449b5 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:00.013155 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-23155758-9eb7-41b4-bd38-44989f6449b5 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f6c755dbf74640a372802f02733eb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f0473c6214a4428be438fabc530012b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:29:00.027885 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-23155758-9eb7-41b4-bd38-44989f6449b5 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] 10.222.0.30 "GET /compute/v2.1/servers/121f052a-2d96-444d-a817-38e348aaf0e5" status: 200 len: 1302 microversion: 2.1 time: 0.209260 Jun 16 18:29:00.033608 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 23/43] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:28:59 2022] GET /compute/v2.1/servers/121f052a-2d96-444d-a817-38e348aaf0e5 => generated 1302 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:29:00.221558 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-504a7cb4-e8fd-4eaf-8131-a3c64adecd9f tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:29:00.222374 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-504a7cb4-e8fd-4eaf-8131-a3c64adecd9f tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] [instance: 651b5fe1-0df7-4bc6-b18e-7caea544a93f] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:29:00.238950 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-504a7cb4-e8fd-4eaf-8131-a3c64adecd9f tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:00.239568 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-504a7cb4-e8fd-4eaf-8131-a3c64adecd9f tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:00.240645 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-504a7cb4-e8fd-4eaf-8131-a3c64adecd9f tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:00.247990 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-504a7cb4-e8fd-4eaf-8131-a3c64adecd9f tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:00.529201 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-504a7cb4-e8fd-4eaf-8131-a3c64adecd9f tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:29:00.539280 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-504a7cb4-e8fd-4eaf-8131-a3c64adecd9f tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:29:00.553682 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-504a7cb4-e8fd-4eaf-8131-a3c64adecd9f tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:29:00.554898 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-504a7cb4-e8fd-4eaf-8131-a3c64adecd9f tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] 10.222.0.30 "GET /compute/v2.1/servers/651b5fe1-0df7-4bc6-b18e-7caea544a93f" status: 200 len: 1278 microversion: 2.20 time: 0.337748 Jun 16 18:29:00.564754 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 24/44] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Jun 16 18:29:00 2022] GET /compute/v2.1/servers/651b5fe1-0df7-4bc6-b18e-7caea544a93f => generated 1278 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:29:00.591462 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-dfe97c91-ee7c-40d1-a602-aa44cfab3b51 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:29:00.592126 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-dfe97c91-ee7c-40d1-a602-aa44cfab3b51 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] [instance: 05981bed-b625-4e9a-b860-6a7ce1288e8d] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:29:00.643595 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-1437b53c-6bdd-4340-9a8b-3fde0a2507ce tempest-DeleteServersTestJSON-823268338 tempest-DeleteServersTestJSON-823268338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee9c06c774f478db33c16b784d6b914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa9111175cad44b2bbc611b7ae36a991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:29:00.673382 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-1437b53c-6bdd-4340-9a8b-3fde0a2507ce tempest-DeleteServersTestJSON-823268338 tempest-DeleteServersTestJSON-823268338-project] 10.222.0.30 "GET /compute/v2.1/servers/58790243-9fe3-49d2-b029-40825911ddde" status: 200 len: 1274 microversion: 2.1 time: 1.152899 Jun 16 18:29:00.692278 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 21/45] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:28:59 2022] GET /compute/v2.1/servers/58790243-9fe3-49d2-b029-40825911ddde => generated 1274 bytes in 1169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:29:00.726680 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-e87de328-c440-41c2-ab21-0cf63343bda3 tempest-VolumesNegativeTest-992612787 tempest-VolumesNegativeTest-992612787-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:29:00.727657 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-e87de328-c440-41c2-ab21-0cf63343bda3 tempest-VolumesNegativeTest-992612787 tempest-VolumesNegativeTest-992612787-project] [instance: b626d1e4-c5fd-47aa-be1f-4dbd8c2d50b5] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:29:00.755939 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-e87de328-c440-41c2-ab21-0cf63343bda3 tempest-VolumesNegativeTest-992612787 tempest-VolumesNegativeTest-992612787-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:00.756446 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-e87de328-c440-41c2-ab21-0cf63343bda3 tempest-VolumesNegativeTest-992612787 tempest-VolumesNegativeTest-992612787-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:00.757254 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-e87de328-c440-41c2-ab21-0cf63343bda3 tempest-VolumesNegativeTest-992612787 tempest-VolumesNegativeTest-992612787-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:00.757710 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-e87de328-c440-41c2-ab21-0cf63343bda3 tempest-VolumesNegativeTest-992612787 tempest-VolumesNegativeTest-992612787-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:00.871724 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-dfe97c91-ee7c-40d1-a602-aa44cfab3b51 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512f01cca14b447c8f6c9eebbd828eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70bbccf07e3404cb94ba59201061a6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:29:00.912864 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-dfe97c91-ee7c-40d1-a602-aa44cfab3b51 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] 10.222.0.30 "GET /compute/v2.1/servers/05981bed-b625-4e9a-b860-6a7ce1288e8d" status: 200 len: 1222 microversion: 2.1 time: 0.341285 Jun 16 18:29:00.919523 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 25/46] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:29:00 2022] GET /compute/v2.1/servers/05981bed-b625-4e9a-b860-6a7ce1288e8d => generated 1222 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:29:01.051018 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-eaf8eddf-a546-4817-bbc0-8e76f9f9fa4d tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:29:01.052101 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-eaf8eddf-a546-4817-bbc0-8e76f9f9fa4d tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] [instance: 121f052a-2d96-444d-a817-38e348aaf0e5] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:29:01.063105 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-eaf8eddf-a546-4817-bbc0-8e76f9f9fa4d tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:01.067565 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-eaf8eddf-a546-4817-bbc0-8e76f9f9fa4d tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:01.069167 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-eaf8eddf-a546-4817-bbc0-8e76f9f9fa4d tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:01.070091 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-eaf8eddf-a546-4817-bbc0-8e76f9f9fa4d tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:01.201127 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-eaf8eddf-a546-4817-bbc0-8e76f9f9fa4d tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f6c755dbf74640a372802f02733eb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f0473c6214a4428be438fabc530012b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:29:01.218186 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-eaf8eddf-a546-4817-bbc0-8e76f9f9fa4d tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] 10.222.0.30 "GET /compute/v2.1/servers/121f052a-2d96-444d-a817-38e348aaf0e5" status: 200 len: 1312 microversion: 2.1 time: 0.164356 Jun 16 18:29:01.230903 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 26/47] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:29:01 2022] GET /compute/v2.1/servers/121f052a-2d96-444d-a817-38e348aaf0e5 => generated 1312 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:29:01.481760 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-e87de328-c440-41c2-ab21-0cf63343bda3 tempest-VolumesNegativeTest-992612787 tempest-VolumesNegativeTest-992612787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '479bda47e66544e8bfa47dad8294c180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '478dbeee61b6401c9dbb31c216ce537b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:29:01.520177 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-e87de328-c440-41c2-ab21-0cf63343bda3 tempest-VolumesNegativeTest-992612787 tempest-VolumesNegativeTest-992612787-project] 10.222.0.30 "GET /compute/v2.1/servers/b626d1e4-c5fd-47aa-be1f-4dbd8c2d50b5" status: 200 len: 1267 microversion: 2.1 time: 0.817384 Jun 16 18:29:01.522315 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 22/48] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:29:00 2022] GET /compute/v2.1/servers/b626d1e4-c5fd-47aa-be1f-4dbd8c2d50b5 => generated 1267 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:29:01.585533 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-3eac3a51-a190-4495-b7ec-3c0bfd1d3f9c tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:29:01.586157 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-3eac3a51-a190-4495-b7ec-3c0bfd1d3f9c tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] [instance: 651b5fe1-0df7-4bc6-b18e-7caea544a93f] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:29:01.594433 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-3eac3a51-a190-4495-b7ec-3c0bfd1d3f9c tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:01.596536 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-3eac3a51-a190-4495-b7ec-3c0bfd1d3f9c tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:01.597708 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-3eac3a51-a190-4495-b7ec-3c0bfd1d3f9c tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:01.598313 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-3eac3a51-a190-4495-b7ec-3c0bfd1d3f9c tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:01.697004 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-f25e7012-1dbb-4354-9960-1be3497d64a9 tempest-DeleteServersTestJSON-823268338 tempest-DeleteServersTestJSON-823268338-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:29:01.698020 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-f25e7012-1dbb-4354-9960-1be3497d64a9 tempest-DeleteServersTestJSON-823268338 tempest-DeleteServersTestJSON-823268338-project] [instance: 58790243-9fe3-49d2-b029-40825911ddde] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:29:01.723082 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG dbcounter [-] [117671] Writing DB stats nova_api:SELECT=77,nova_api:INSERT=10 {{(pid=117671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:29:01.724834 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-f25e7012-1dbb-4354-9960-1be3497d64a9 tempest-DeleteServersTestJSON-823268338 tempest-DeleteServersTestJSON-823268338-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:01.725296 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-f25e7012-1dbb-4354-9960-1be3497d64a9 tempest-DeleteServersTestJSON-823268338 tempest-DeleteServersTestJSON-823268338-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:01.726107 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-f25e7012-1dbb-4354-9960-1be3497d64a9 tempest-DeleteServersTestJSON-823268338 tempest-DeleteServersTestJSON-823268338-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:01.726548 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-f25e7012-1dbb-4354-9960-1be3497d64a9 tempest-DeleteServersTestJSON-823268338 tempest-DeleteServersTestJSON-823268338-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:01.733020 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-3eac3a51-a190-4495-b7ec-3c0bfd1d3f9c tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:29:01.755552 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-3eac3a51-a190-4495-b7ec-3c0bfd1d3f9c tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:29:01.757967 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-3eac3a51-a190-4495-b7ec-3c0bfd1d3f9c tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:29:01.759681 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-3eac3a51-a190-4495-b7ec-3c0bfd1d3f9c tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] 10.222.0.30 "GET /compute/v2.1/servers/651b5fe1-0df7-4bc6-b18e-7caea544a93f" status: 200 len: 1334 microversion: 2.20 time: 0.179249 Jun 16 18:29:01.762297 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 27/49] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Jun 16 18:29:01 2022] GET /compute/v2.1/servers/651b5fe1-0df7-4bc6-b18e-7caea544a93f => generated 1334 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:29:01.966266 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-08095b7f-e700-4ced-a6b1-b8c131db00bc tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:29:01.971469 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-08095b7f-e700-4ced-a6b1-b8c131db00bc tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] [instance: 05981bed-b625-4e9a-b860-6a7ce1288e8d] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:29:01.989978 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG dbcounter [-] [117670] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=10 {{(pid=117670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:29:02.035784 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-08095b7f-e700-4ced-a6b1-b8c131db00bc tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:02.038641 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-08095b7f-e700-4ced-a6b1-b8c131db00bc tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:02.040219 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-08095b7f-e700-4ced-a6b1-b8c131db00bc tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:02.049511 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-08095b7f-e700-4ced-a6b1-b8c131db00bc tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:02.509200 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-08095b7f-e700-4ced-a6b1-b8c131db00bc tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512f01cca14b447c8f6c9eebbd828eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70bbccf07e3404cb94ba59201061a6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:29:02.521751 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-08095b7f-e700-4ced-a6b1-b8c131db00bc tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] 10.222.0.30 "GET /compute/v2.1/servers/05981bed-b625-4e9a-b860-6a7ce1288e8d" status: 200 len: 1218 microversion: 2.1 time: 0.575744 Jun 16 18:29:02.527218 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 28/50] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:29:01 2022] GET /compute/v2.1/servers/05981bed-b625-4e9a-b860-6a7ce1288e8d => generated 1218 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:29:02.541426 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-a51a5f6b-b2d3-4e75-8d91-2b1326450910 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:29:02.546297 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-a51a5f6b-b2d3-4e75-8d91-2b1326450910 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] [instance: 121f052a-2d96-444d-a817-38e348aaf0e5] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:29:02.612586 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-a51a5f6b-b2d3-4e75-8d91-2b1326450910 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:02.618435 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-a51a5f6b-b2d3-4e75-8d91-2b1326450910 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:02.626205 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-a51a5f6b-b2d3-4e75-8d91-2b1326450910 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:02.633379 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-a51a5f6b-b2d3-4e75-8d91-2b1326450910 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:02.909518 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-a51a5f6b-b2d3-4e75-8d91-2b1326450910 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f6c755dbf74640a372802f02733eb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f0473c6214a4428be438fabc530012b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:29:02.941285 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-a51a5f6b-b2d3-4e75-8d91-2b1326450910 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] 10.222.0.30 "GET /compute/v2.1/servers/121f052a-2d96-444d-a817-38e348aaf0e5" status: 200 len: 1300 microversion: 2.1 time: 0.412390 Jun 16 18:29:02.954746 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 29/51] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:29:02 2022] GET /compute/v2.1/servers/121f052a-2d96-444d-a817-38e348aaf0e5 => generated 1300 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:29:02.971018 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-88cf836b-48a8-4616-ac2d-42ed3c340f42 tempest-VolumesNegativeTest-992612787 tempest-VolumesNegativeTest-992612787-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:29:02.974017 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-88cf836b-48a8-4616-ac2d-42ed3c340f42 tempest-VolumesNegativeTest-992612787 tempest-VolumesNegativeTest-992612787-project] [instance: b626d1e4-c5fd-47aa-be1f-4dbd8c2d50b5] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:29:02.995898 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-88cf836b-48a8-4616-ac2d-42ed3c340f42 tempest-VolumesNegativeTest-992612787 tempest-VolumesNegativeTest-992612787-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:03.012081 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-88cf836b-48a8-4616-ac2d-42ed3c340f42 tempest-VolumesNegativeTest-992612787 tempest-VolumesNegativeTest-992612787-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:03.016212 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-88cf836b-48a8-4616-ac2d-42ed3c340f42 tempest-VolumesNegativeTest-992612787 tempest-VolumesNegativeTest-992612787-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:03.021785 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-88cf836b-48a8-4616-ac2d-42ed3c340f42 tempest-VolumesNegativeTest-992612787 tempest-VolumesNegativeTest-992612787-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:03.609115 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-f25e7012-1dbb-4354-9960-1be3497d64a9 tempest-DeleteServersTestJSON-823268338 tempest-DeleteServersTestJSON-823268338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee9c06c774f478db33c16b784d6b914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa9111175cad44b2bbc611b7ae36a991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:29:03.647175 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-f25e7012-1dbb-4354-9960-1be3497d64a9 tempest-DeleteServersTestJSON-823268338 tempest-DeleteServersTestJSON-823268338-project] 10.222.0.30 "GET /compute/v2.1/servers/58790243-9fe3-49d2-b029-40825911ddde" status: 200 len: 1272 microversion: 2.1 time: 1.959305 Jun 16 18:29:03.668789 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 23/52] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:29:01 2022] GET /compute/v2.1/servers/58790243-9fe3-49d2-b029-40825911ddde => generated 1272 bytes in 1983 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:29:03.727986 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-51859739-058a-4f27-8dc3-a5cbc4cf97f3 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:29:03.729281 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-51859739-058a-4f27-8dc3-a5cbc4cf97f3 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] [instance: 651b5fe1-0df7-4bc6-b18e-7caea544a93f] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:29:03.776121 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-51859739-058a-4f27-8dc3-a5cbc4cf97f3 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:03.785426 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-51859739-058a-4f27-8dc3-a5cbc4cf97f3 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:03.786748 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-51859739-058a-4f27-8dc3-a5cbc4cf97f3 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:03.787534 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-51859739-058a-4f27-8dc3-a5cbc4cf97f3 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:04.237047 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-88cf836b-48a8-4616-ac2d-42ed3c340f42 tempest-VolumesNegativeTest-992612787 tempest-VolumesNegativeTest-992612787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '479bda47e66544e8bfa47dad8294c180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '478dbeee61b6401c9dbb31c216ce537b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:29:04.254453 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-88cf836b-48a8-4616-ac2d-42ed3c340f42 tempest-VolumesNegativeTest-992612787 tempest-VolumesNegativeTest-992612787-project] 10.222.0.30 "GET /compute/v2.1/servers/b626d1e4-c5fd-47aa-be1f-4dbd8c2d50b5" status: 200 len: 1275 microversion: 2.1 time: 1.297785 Jun 16 18:29:04.255433 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 30/53] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:29:02 2022] GET /compute/v2.1/servers/b626d1e4-c5fd-47aa-be1f-4dbd8c2d50b5 => generated 1275 bytes in 1300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:29:04.294876 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-850126c0-6cde-4061-bae0-37de1a5015b3 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:29:04.325304 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-850126c0-6cde-4061-bae0-37de1a5015b3 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] [instance: 05981bed-b625-4e9a-b860-6a7ce1288e8d] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:29:04.410991 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-850126c0-6cde-4061-bae0-37de1a5015b3 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:04.411762 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-850126c0-6cde-4061-bae0-37de1a5015b3 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.034s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:04.413786 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-850126c0-6cde-4061-bae0-37de1a5015b3 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:04.414676 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-850126c0-6cde-4061-bae0-37de1a5015b3 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:04.890641 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-850126c0-6cde-4061-bae0-37de1a5015b3 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512f01cca14b447c8f6c9eebbd828eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70bbccf07e3404cb94ba59201061a6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:29:04.902371 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-850126c0-6cde-4061-bae0-37de1a5015b3 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] 10.222.0.30 "GET /compute/v2.1/servers/05981bed-b625-4e9a-b860-6a7ce1288e8d" status: 200 len: 1280 microversion: 2.1 time: 0.617888 Jun 16 18:29:04.903713 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 31/54] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:29:04 2022] GET /compute/v2.1/servers/05981bed-b625-4e9a-b860-6a7ce1288e8d => generated 1280 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:29:04.916320 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-4872833b-7f29-40db-a8aa-9ae758fa5933 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:29:04.921032 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-4872833b-7f29-40db-a8aa-9ae758fa5933 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] [instance: 121f052a-2d96-444d-a817-38e348aaf0e5] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:29:04.928173 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-51859739-058a-4f27-8dc3-a5cbc4cf97f3 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:29:04.945003 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-4872833b-7f29-40db-a8aa-9ae758fa5933 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:04.945812 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-4872833b-7f29-40db-a8aa-9ae758fa5933 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:04.947797 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-4872833b-7f29-40db-a8aa-9ae758fa5933 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:04.948779 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-51859739-058a-4f27-8dc3-a5cbc4cf97f3 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:29:04.949695 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-4872833b-7f29-40db-a8aa-9ae758fa5933 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:04.955128 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-51859739-058a-4f27-8dc3-a5cbc4cf97f3 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:29:04.960866 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-51859739-058a-4f27-8dc3-a5cbc4cf97f3 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] 10.222.0.30 "GET /compute/v2.1/servers/651b5fe1-0df7-4bc6-b18e-7caea544a93f" status: 200 len: 1340 microversion: 2.20 time: 1.289182 Jun 16 18:29:04.981966 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 24/55] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Jun 16 18:29:03 2022] GET /compute/v2.1/servers/651b5fe1-0df7-4bc6-b18e-7caea544a93f => generated 1340 bytes in 1310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:29:05.015726 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-1b6e098d-1753-411a-9b81-0fba312e1286 tempest-DeleteServersTestJSON-823268338 tempest-DeleteServersTestJSON-823268338-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:29:05.027023 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-1b6e098d-1753-411a-9b81-0fba312e1286 tempest-DeleteServersTestJSON-823268338 tempest-DeleteServersTestJSON-823268338-project] [instance: 58790243-9fe3-49d2-b029-40825911ddde] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:29:05.055626 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-1b6e098d-1753-411a-9b81-0fba312e1286 tempest-DeleteServersTestJSON-823268338 tempest-DeleteServersTestJSON-823268338-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:05.058215 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-1b6e098d-1753-411a-9b81-0fba312e1286 tempest-DeleteServersTestJSON-823268338 tempest-DeleteServersTestJSON-823268338-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:05.064220 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-1b6e098d-1753-411a-9b81-0fba312e1286 tempest-DeleteServersTestJSON-823268338 tempest-DeleteServersTestJSON-823268338-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:05.066169 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-1b6e098d-1753-411a-9b81-0fba312e1286 tempest-DeleteServersTestJSON-823268338 tempest-DeleteServersTestJSON-823268338-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:05.597434 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-4872833b-7f29-40db-a8aa-9ae758fa5933 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f6c755dbf74640a372802f02733eb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f0473c6214a4428be438fabc530012b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:29:05.618539 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-4872833b-7f29-40db-a8aa-9ae758fa5933 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] 10.222.0.30 "GET /compute/v2.1/servers/121f052a-2d96-444d-a817-38e348aaf0e5" status: 200 len: 1300 microversion: 2.1 time: 0.711930 Jun 16 18:29:05.621451 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 32/56] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:29:04 2022] GET /compute/v2.1/servers/121f052a-2d96-444d-a817-38e348aaf0e5 => generated 1300 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:29:05.631763 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-350cbe55-c535-4d6d-b724-e0dba25b62c0 tempest-VolumesNegativeTest-992612787 tempest-VolumesNegativeTest-992612787-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:29:05.637637 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-350cbe55-c535-4d6d-b724-e0dba25b62c0 tempest-VolumesNegativeTest-992612787 tempest-VolumesNegativeTest-992612787-project] [instance: b626d1e4-c5fd-47aa-be1f-4dbd8c2d50b5] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:29:05.652005 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-350cbe55-c535-4d6d-b724-e0dba25b62c0 tempest-VolumesNegativeTest-992612787 tempest-VolumesNegativeTest-992612787-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:05.656901 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-350cbe55-c535-4d6d-b724-e0dba25b62c0 tempest-VolumesNegativeTest-992612787 tempest-VolumesNegativeTest-992612787-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:05.658517 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-350cbe55-c535-4d6d-b724-e0dba25b62c0 tempest-VolumesNegativeTest-992612787 tempest-VolumesNegativeTest-992612787-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:05.660792 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-350cbe55-c535-4d6d-b724-e0dba25b62c0 tempest-VolumesNegativeTest-992612787 tempest-VolumesNegativeTest-992612787-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:06.504296 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-1b6e098d-1753-411a-9b81-0fba312e1286 tempest-DeleteServersTestJSON-823268338 tempest-DeleteServersTestJSON-823268338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee9c06c774f478db33c16b784d6b914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa9111175cad44b2bbc611b7ae36a991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:29:06.543273 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-1b6e098d-1753-411a-9b81-0fba312e1286 tempest-DeleteServersTestJSON-823268338 tempest-DeleteServersTestJSON-823268338-project] 10.222.0.30 "GET /compute/v2.1/servers/58790243-9fe3-49d2-b029-40825911ddde" status: 200 len: 1314 microversion: 2.1 time: 1.544926 Jun 16 18:29:06.544479 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 25/57] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:29:04 2022] GET /compute/v2.1/servers/58790243-9fe3-49d2-b029-40825911ddde => generated 1314 bytes in 1562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:29:06.569800 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-1e0a2f19-1f59-4db3-902c-fe35d8ba62a1 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:29:06.570989 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-1e0a2f19-1f59-4db3-902c-fe35d8ba62a1 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] [instance: 05981bed-b625-4e9a-b860-6a7ce1288e8d] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:29:06.661454 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-1e0a2f19-1f59-4db3-902c-fe35d8ba62a1 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:06.663428 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-1e0a2f19-1f59-4db3-902c-fe35d8ba62a1 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:06.704741 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-1e0a2f19-1f59-4db3-902c-fe35d8ba62a1 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:06.709826 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-1e0a2f19-1f59-4db3-902c-fe35d8ba62a1 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.028s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:07.158018 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG dbcounter [-] [117670] Writing DB stats nova_cell0:SELECT=6 {{(pid=117670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:29:07.575465 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-350cbe55-c535-4d6d-b724-e0dba25b62c0 tempest-VolumesNegativeTest-992612787 tempest-VolumesNegativeTest-992612787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '479bda47e66544e8bfa47dad8294c180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '478dbeee61b6401c9dbb31c216ce537b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:29:07.597765 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-350cbe55-c535-4d6d-b724-e0dba25b62c0 tempest-VolumesNegativeTest-992612787 tempest-VolumesNegativeTest-992612787-project] 10.222.0.30 "GET /compute/v2.1/servers/b626d1e4-c5fd-47aa-be1f-4dbd8c2d50b5" status: 200 len: 1273 microversion: 2.1 time: 1.975113 Jun 16 18:29:07.606375 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 33/58] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:29:05 2022] GET /compute/v2.1/servers/b626d1e4-c5fd-47aa-be1f-4dbd8c2d50b5 => generated 1273 bytes in 1985 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:29:07.645640 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-abfed564-8d54-404f-b458-e52caaeca993 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:29:07.657573 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-abfed564-8d54-404f-b458-e52caaeca993 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] [instance: 651b5fe1-0df7-4bc6-b18e-7caea544a93f] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:29:07.727562 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-abfed564-8d54-404f-b458-e52caaeca993 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:07.730148 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-abfed564-8d54-404f-b458-e52caaeca993 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:07.741488 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-abfed564-8d54-404f-b458-e52caaeca993 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:07.743827 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-abfed564-8d54-404f-b458-e52caaeca993 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:07.824281 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-1e0a2f19-1f59-4db3-902c-fe35d8ba62a1 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512f01cca14b447c8f6c9eebbd828eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70bbccf07e3404cb94ba59201061a6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:29:07.889242 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-1e0a2f19-1f59-4db3-902c-fe35d8ba62a1 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] 10.222.0.30 "GET /compute/v2.1/servers/05981bed-b625-4e9a-b860-6a7ce1288e8d" status: 200 len: 1280 microversion: 2.1 time: 1.328460 Jun 16 18:29:07.911690 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG dbcounter [-] [117670] Writing DB stats nova_cell1:SELECT=100 {{(pid=117670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:29:07.911812 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 26/59] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:29:06 2022] GET /compute/v2.1/servers/05981bed-b625-4e9a-b860-6a7ce1288e8d => generated 1280 bytes in 1354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:29:07.979536 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-9b40d863-9404-4210-9060-76348694a0a5 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:29:07.984801 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-9b40d863-9404-4210-9060-76348694a0a5 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] [instance: 121f052a-2d96-444d-a817-38e348aaf0e5] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:29:08.032762 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-9b40d863-9404-4210-9060-76348694a0a5 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:08.034904 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-9b40d863-9404-4210-9060-76348694a0a5 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:08.036950 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-9b40d863-9404-4210-9060-76348694a0a5 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:08.038177 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-9b40d863-9404-4210-9060-76348694a0a5 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:08.148684 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-abfed564-8d54-404f-b458-e52caaeca993 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:29:08.201085 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-abfed564-8d54-404f-b458-e52caaeca993 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:29:08.221170 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-abfed564-8d54-404f-b458-e52caaeca993 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:29:08.227346 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-abfed564-8d54-404f-b458-e52caaeca993 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] 10.222.0.30 "GET /compute/v2.1/servers/651b5fe1-0df7-4bc6-b18e-7caea544a93f" status: 200 len: 1340 microversion: 2.20 time: 0.617859 Jun 16 18:29:08.231858 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 34/60] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Jun 16 18:29:07 2022] GET /compute/v2.1/servers/651b5fe1-0df7-4bc6-b18e-7caea544a93f => generated 1340 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:29:08.250928 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-09bf571d-5fab-4ae2-a992-c107b7792909 tempest-DeleteServersTestJSON-823268338 tempest-DeleteServersTestJSON-823268338-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:29:08.253461 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-09bf571d-5fab-4ae2-a992-c107b7792909 tempest-DeleteServersTestJSON-823268338 tempest-DeleteServersTestJSON-823268338-project] [instance: 58790243-9fe3-49d2-b029-40825911ddde] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:29:08.286919 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-09bf571d-5fab-4ae2-a992-c107b7792909 tempest-DeleteServersTestJSON-823268338 tempest-DeleteServersTestJSON-823268338-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:08.301688 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-09bf571d-5fab-4ae2-a992-c107b7792909 tempest-DeleteServersTestJSON-823268338 tempest-DeleteServersTestJSON-823268338-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:08.303471 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-09bf571d-5fab-4ae2-a992-c107b7792909 tempest-DeleteServersTestJSON-823268338 tempest-DeleteServersTestJSON-823268338-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:08.315099 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-09bf571d-5fab-4ae2-a992-c107b7792909 tempest-DeleteServersTestJSON-823268338 tempest-DeleteServersTestJSON-823268338-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:08.957577 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG dbcounter [-] [117671] Writing DB stats nova_cell0:SELECT=6 {{(pid=117671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:29:09.268933 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG dbcounter [-] [117671] Writing DB stats nova_cell0:SELECT=30 {{(pid=117671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:29:09.326086 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-9b40d863-9404-4210-9060-76348694a0a5 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f6c755dbf74640a372802f02733eb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f0473c6214a4428be438fabc530012b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:29:09.373098 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-9b40d863-9404-4210-9060-76348694a0a5 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] 10.222.0.30 "GET /compute/v2.1/servers/121f052a-2d96-444d-a817-38e348aaf0e5" status: 200 len: 1368 microversion: 2.1 time: 1.465174 Jun 16 18:29:09.378890 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 27/61] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:29:07 2022] GET /compute/v2.1/servers/121f052a-2d96-444d-a817-38e348aaf0e5 => generated 1368 bytes in 1472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:29:09.410934 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-004046d7-dede-4014-a7fc-2a101b27ab0e tempest-VolumesNegativeTest-992612787 tempest-VolumesNegativeTest-992612787-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:29:09.412266 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-004046d7-dede-4014-a7fc-2a101b27ab0e tempest-VolumesNegativeTest-992612787 tempest-VolumesNegativeTest-992612787-project] [instance: b626d1e4-c5fd-47aa-be1f-4dbd8c2d50b5] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:29:09.426828 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-004046d7-dede-4014-a7fc-2a101b27ab0e tempest-VolumesNegativeTest-992612787 tempest-VolumesNegativeTest-992612787-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:09.432873 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-004046d7-dede-4014-a7fc-2a101b27ab0e tempest-VolumesNegativeTest-992612787 tempest-VolumesNegativeTest-992612787-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:09.434023 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-004046d7-dede-4014-a7fc-2a101b27ab0e tempest-VolumesNegativeTest-992612787 tempest-VolumesNegativeTest-992612787-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:09.434628 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-004046d7-dede-4014-a7fc-2a101b27ab0e tempest-VolumesNegativeTest-992612787 tempest-VolumesNegativeTest-992612787-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:09.926560 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-004046d7-dede-4014-a7fc-2a101b27ab0e tempest-VolumesNegativeTest-992612787 tempest-VolumesNegativeTest-992612787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '479bda47e66544e8bfa47dad8294c180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '478dbeee61b6401c9dbb31c216ce537b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:29:09.977613 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-004046d7-dede-4014-a7fc-2a101b27ab0e tempest-VolumesNegativeTest-992612787 tempest-VolumesNegativeTest-992612787-project] 10.222.0.30 "GET /compute/v2.1/servers/b626d1e4-c5fd-47aa-be1f-4dbd8c2d50b5" status: 200 len: 1273 microversion: 2.1 time: 0.592853 Jun 16 18:29:09.980990 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 28/62] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:29:09 2022] GET /compute/v2.1/servers/b626d1e4-c5fd-47aa-be1f-4dbd8c2d50b5 => generated 1273 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:29:10.007595 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-c7ed3a2a-b13f-4285-88fc-d736c7fa4315 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:29:10.013655 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-c7ed3a2a-b13f-4285-88fc-d736c7fa4315 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] [instance: 05981bed-b625-4e9a-b860-6a7ce1288e8d] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:29:10.050885 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-c7ed3a2a-b13f-4285-88fc-d736c7fa4315 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:10.058827 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-c7ed3a2a-b13f-4285-88fc-d736c7fa4315 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:10.065907 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-c7ed3a2a-b13f-4285-88fc-d736c7fa4315 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:10.069058 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-c7ed3a2a-b13f-4285-88fc-d736c7fa4315 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:10.253728 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-c7ed3a2a-b13f-4285-88fc-d736c7fa4315 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512f01cca14b447c8f6c9eebbd828eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70bbccf07e3404cb94ba59201061a6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:29:10.306868 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-c7ed3a2a-b13f-4285-88fc-d736c7fa4315 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] 10.222.0.30 "GET /compute/v2.1/servers/05981bed-b625-4e9a-b860-6a7ce1288e8d" status: 200 len: 1280 microversion: 2.1 time: 0.324131 Jun 16 18:29:10.313359 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 29/63] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:29:09 2022] GET /compute/v2.1/servers/05981bed-b625-4e9a-b860-6a7ce1288e8d => generated 1280 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:29:10.322043 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-09bf571d-5fab-4ae2-a992-c107b7792909 tempest-DeleteServersTestJSON-823268338 tempest-DeleteServersTestJSON-823268338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee9c06c774f478db33c16b784d6b914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa9111175cad44b2bbc611b7ae36a991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:29:10.333576 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-d9bbfad8-ed87-4f07-a1b0-ce20352feb3d tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:29:10.335898 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-d9bbfad8-ed87-4f07-a1b0-ce20352feb3d tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] [instance: 651b5fe1-0df7-4bc6-b18e-7caea544a93f] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:29:10.352622 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-d9bbfad8-ed87-4f07-a1b0-ce20352feb3d tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:10.353278 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-d9bbfad8-ed87-4f07-a1b0-ce20352feb3d tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:10.355402 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-d9bbfad8-ed87-4f07-a1b0-ce20352feb3d tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:10.356479 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-d9bbfad8-ed87-4f07-a1b0-ce20352feb3d tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:10.356654 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-09bf571d-5fab-4ae2-a992-c107b7792909 tempest-DeleteServersTestJSON-823268338 tempest-DeleteServersTestJSON-823268338-project] 10.222.0.30 "GET /compute/v2.1/servers/58790243-9fe3-49d2-b029-40825911ddde" status: 200 len: 1314 microversion: 2.1 time: 2.114290 Jun 16 18:29:10.357269 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 35/64] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:29:08 2022] GET /compute/v2.1/servers/58790243-9fe3-49d2-b029-40825911ddde => generated 1314 bytes in 2116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:29:10.404316 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-ba4ec7ee-955b-4241-b158-bff423cee30d tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:29:10.404946 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-ba4ec7ee-955b-4241-b158-bff423cee30d tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] [instance: 121f052a-2d96-444d-a817-38e348aaf0e5] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:29:10.416372 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-ba4ec7ee-955b-4241-b158-bff423cee30d tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:10.416612 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-ba4ec7ee-955b-4241-b158-bff423cee30d tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:10.418569 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-ba4ec7ee-955b-4241-b158-bff423cee30d tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:10.419166 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-ba4ec7ee-955b-4241-b158-bff423cee30d tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:10.902437 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG dbcounter [-] [117670] Writing DB stats nova_cell0:SELECT=30 {{(pid=117670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:29:10.934173 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-d9bbfad8-ed87-4f07-a1b0-ce20352feb3d tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:29:10.975139 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-d9bbfad8-ed87-4f07-a1b0-ce20352feb3d tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:29:10.989140 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-d9bbfad8-ed87-4f07-a1b0-ce20352feb3d tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:29:10.997610 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-d9bbfad8-ed87-4f07-a1b0-ce20352feb3d tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] 10.222.0.30 "GET /compute/v2.1/servers/651b5fe1-0df7-4bc6-b18e-7caea544a93f" status: 200 len: 1340 microversion: 2.20 time: 0.682009 Jun 16 18:29:11.001620 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 30/65] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Jun 16 18:29:10 2022] GET /compute/v2.1/servers/651b5fe1-0df7-4bc6-b18e-7caea544a93f => generated 1340 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:29:11.029717 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-43a094d0-f343-4a97-83c6-1f75feef5ab3 tempest-VolumesNegativeTest-992612787 tempest-VolumesNegativeTest-992612787-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:29:11.031245 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-43a094d0-f343-4a97-83c6-1f75feef5ab3 tempest-VolumesNegativeTest-992612787 tempest-VolumesNegativeTest-992612787-project] [instance: b626d1e4-c5fd-47aa-be1f-4dbd8c2d50b5] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:29:11.072450 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-43a094d0-f343-4a97-83c6-1f75feef5ab3 tempest-VolumesNegativeTest-992612787 tempest-VolumesNegativeTest-992612787-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:11.076410 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-43a094d0-f343-4a97-83c6-1f75feef5ab3 tempest-VolumesNegativeTest-992612787 tempest-VolumesNegativeTest-992612787-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:11.084959 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-43a094d0-f343-4a97-83c6-1f75feef5ab3 tempest-VolumesNegativeTest-992612787 tempest-VolumesNegativeTest-992612787-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:11.090004 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-43a094d0-f343-4a97-83c6-1f75feef5ab3 tempest-VolumesNegativeTest-992612787 tempest-VolumesNegativeTest-992612787-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:11.282709 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-43a094d0-f343-4a97-83c6-1f75feef5ab3 tempest-VolumesNegativeTest-992612787 tempest-VolumesNegativeTest-992612787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '479bda47e66544e8bfa47dad8294c180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '478dbeee61b6401c9dbb31c216ce537b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:29:11.347894 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-43a094d0-f343-4a97-83c6-1f75feef5ab3 tempest-VolumesNegativeTest-992612787 tempest-VolumesNegativeTest-992612787-project] 10.222.0.30 "GET /compute/v2.1/servers/b626d1e4-c5fd-47aa-be1f-4dbd8c2d50b5" status: 200 len: 1273 microversion: 2.1 time: 0.315125 Jun 16 18:29:11.349431 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 31/66] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:29:11 2022] GET /compute/v2.1/servers/b626d1e4-c5fd-47aa-be1f-4dbd8c2d50b5 => generated 1273 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:29:11.367782 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-8cd60236-b9e5-42df-9d67-bc0c666985b5 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:29:11.369203 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-8cd60236-b9e5-42df-9d67-bc0c666985b5 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] [instance: 05981bed-b625-4e9a-b860-6a7ce1288e8d] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:29:11.407889 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-8cd60236-b9e5-42df-9d67-bc0c666985b5 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:11.414744 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-8cd60236-b9e5-42df-9d67-bc0c666985b5 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:11.418498 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-8cd60236-b9e5-42df-9d67-bc0c666985b5 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:11.435856 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-8cd60236-b9e5-42df-9d67-bc0c666985b5 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:12.531783 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-8cd60236-b9e5-42df-9d67-bc0c666985b5 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512f01cca14b447c8f6c9eebbd828eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70bbccf07e3404cb94ba59201061a6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:29:12.552111 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-8cd60236-b9e5-42df-9d67-bc0c666985b5 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] 10.222.0.30 "GET /compute/v2.1/servers/05981bed-b625-4e9a-b860-6a7ce1288e8d" status: 200 len: 1280 microversion: 2.1 time: 1.201011 Jun 16 18:29:12.560880 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 32/67] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:29:11 2022] GET /compute/v2.1/servers/05981bed-b625-4e9a-b860-6a7ce1288e8d => generated 1280 bytes in 1211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:29:12.569949 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-856ba4bb-893a-49bf-91e7-ad5aa6d9aa2c tempest-DeleteServersTestJSON-823268338 tempest-DeleteServersTestJSON-823268338-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:29:12.585098 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-856ba4bb-893a-49bf-91e7-ad5aa6d9aa2c tempest-DeleteServersTestJSON-823268338 tempest-DeleteServersTestJSON-823268338-project] [instance: 58790243-9fe3-49d2-b029-40825911ddde] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:29:12.601997 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-856ba4bb-893a-49bf-91e7-ad5aa6d9aa2c tempest-DeleteServersTestJSON-823268338 tempest-DeleteServersTestJSON-823268338-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:12.606941 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-856ba4bb-893a-49bf-91e7-ad5aa6d9aa2c tempest-DeleteServersTestJSON-823268338 tempest-DeleteServersTestJSON-823268338-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:12.609536 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-856ba4bb-893a-49bf-91e7-ad5aa6d9aa2c tempest-DeleteServersTestJSON-823268338 tempest-DeleteServersTestJSON-823268338-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:12.620808 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-856ba4bb-893a-49bf-91e7-ad5aa6d9aa2c tempest-DeleteServersTestJSON-823268338 tempest-DeleteServersTestJSON-823268338-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:12.680690 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG dbcounter [-] [117671] Writing DB stats nova_cell1:SELECT=100 {{(pid=117671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:29:13.011532 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-ba4ec7ee-955b-4241-b158-bff423cee30d tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f6c755dbf74640a372802f02733eb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f0473c6214a4428be438fabc530012b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:29:13.031703 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-ba4ec7ee-955b-4241-b158-bff423cee30d tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] 10.222.0.30 "GET /compute/v2.1/servers/121f052a-2d96-444d-a817-38e348aaf0e5" status: 200 len: 1368 microversion: 2.1 time: 2.632691 Jun 16 18:29:13.032465 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 36/68] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:29:10 2022] GET /compute/v2.1/servers/121f052a-2d96-444d-a817-38e348aaf0e5 => generated 1368 bytes in 2634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:29:13.079296 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-a18a8d24-c9de-49bf-a20b-4e273ea7fb0b tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:29:13.083704 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-a18a8d24-c9de-49bf-a20b-4e273ea7fb0b tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] [instance: 651b5fe1-0df7-4bc6-b18e-7caea544a93f] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:29:13.125407 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-a18a8d24-c9de-49bf-a20b-4e273ea7fb0b tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:13.130748 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-a18a8d24-c9de-49bf-a20b-4e273ea7fb0b tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:13.139472 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-a18a8d24-c9de-49bf-a20b-4e273ea7fb0b tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:13.142464 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-a18a8d24-c9de-49bf-a20b-4e273ea7fb0b tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:13.299241 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-856ba4bb-893a-49bf-91e7-ad5aa6d9aa2c tempest-DeleteServersTestJSON-823268338 tempest-DeleteServersTestJSON-823268338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee9c06c774f478db33c16b784d6b914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa9111175cad44b2bbc611b7ae36a991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:29:13.309816 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-856ba4bb-893a-49bf-91e7-ad5aa6d9aa2c tempest-DeleteServersTestJSON-823268338 tempest-DeleteServersTestJSON-823268338-project] 10.222.0.30 "GET /compute/v2.1/servers/58790243-9fe3-49d2-b029-40825911ddde" status: 200 len: 1314 microversion: 2.1 time: 0.747394 Jun 16 18:29:13.317522 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 33/69] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:29:12 2022] GET /compute/v2.1/servers/58790243-9fe3-49d2-b029-40825911ddde => generated 1314 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:29:13.335263 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-69b60e06-65e0-4c75-99de-1586cdc35dfc tempest-VolumesNegativeTest-992612787 tempest-VolumesNegativeTest-992612787-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:29:13.357535 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-69b60e06-65e0-4c75-99de-1586cdc35dfc tempest-VolumesNegativeTest-992612787 tempest-VolumesNegativeTest-992612787-project] [instance: b626d1e4-c5fd-47aa-be1f-4dbd8c2d50b5] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:29:13.410039 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-69b60e06-65e0-4c75-99de-1586cdc35dfc tempest-VolumesNegativeTest-992612787 tempest-VolumesNegativeTest-992612787-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:13.412081 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-69b60e06-65e0-4c75-99de-1586cdc35dfc tempest-VolumesNegativeTest-992612787 tempest-VolumesNegativeTest-992612787-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:13.424573 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-69b60e06-65e0-4c75-99de-1586cdc35dfc tempest-VolumesNegativeTest-992612787 tempest-VolumesNegativeTest-992612787-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:13.425895 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-69b60e06-65e0-4c75-99de-1586cdc35dfc tempest-VolumesNegativeTest-992612787 tempest-VolumesNegativeTest-992612787-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:13.589688 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-a18a8d24-c9de-49bf-a20b-4e273ea7fb0b tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:29:13.609733 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-a18a8d24-c9de-49bf-a20b-4e273ea7fb0b tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:29:13.611484 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-a18a8d24-c9de-49bf-a20b-4e273ea7fb0b tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:29:13.613145 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-a18a8d24-c9de-49bf-a20b-4e273ea7fb0b tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] 10.222.0.30 "GET /compute/v2.1/servers/651b5fe1-0df7-4bc6-b18e-7caea544a93f" status: 200 len: 1340 microversion: 2.20 time: 0.571499 Jun 16 18:29:13.614160 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 37/70] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Jun 16 18:29:13 2022] GET /compute/v2.1/servers/651b5fe1-0df7-4bc6-b18e-7caea544a93f => generated 1340 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:29:13.629181 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-00b442d7-75d3-42db-af6d-79c21e311602 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:29:13.630032 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-00b442d7-75d3-42db-af6d-79c21e311602 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] [instance: 05981bed-b625-4e9a-b860-6a7ce1288e8d] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:29:13.647522 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-00b442d7-75d3-42db-af6d-79c21e311602 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:13.648979 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-00b442d7-75d3-42db-af6d-79c21e311602 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:13.654453 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-00b442d7-75d3-42db-af6d-79c21e311602 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:13.654699 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-00b442d7-75d3-42db-af6d-79c21e311602 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:13.711331 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-69b60e06-65e0-4c75-99de-1586cdc35dfc tempest-VolumesNegativeTest-992612787 tempest-VolumesNegativeTest-992612787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '479bda47e66544e8bfa47dad8294c180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '478dbeee61b6401c9dbb31c216ce537b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:29:13.730251 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-69b60e06-65e0-4c75-99de-1586cdc35dfc tempest-VolumesNegativeTest-992612787 tempest-VolumesNegativeTest-992612787-project] 10.222.0.30 "GET /compute/v2.1/servers/b626d1e4-c5fd-47aa-be1f-4dbd8c2d50b5" status: 200 len: 1273 microversion: 2.1 time: 0.406702 Jun 16 18:29:13.738155 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 34/71] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:29:13 2022] GET /compute/v2.1/servers/b626d1e4-c5fd-47aa-be1f-4dbd8c2d50b5 => generated 1273 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:29:14.043109 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-00b442d7-75d3-42db-af6d-79c21e311602 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512f01cca14b447c8f6c9eebbd828eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70bbccf07e3404cb94ba59201061a6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:29:14.053137 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-00b442d7-75d3-42db-af6d-79c21e311602 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] 10.222.0.30 "GET /compute/v2.1/servers/05981bed-b625-4e9a-b860-6a7ce1288e8d" status: 200 len: 1280 microversion: 2.1 time: 0.433567 Jun 16 18:29:14.062635 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-5b3bebe6-dd07-4843-844b-0883c6094834 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:29:14.064023 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-5b3bebe6-dd07-4843-844b-0883c6094834 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] [instance: 121f052a-2d96-444d-a817-38e348aaf0e5] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:29:14.076347 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-5b3bebe6-dd07-4843-844b-0883c6094834 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:14.076746 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 38/72] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:29:13 2022] GET /compute/v2.1/servers/05981bed-b625-4e9a-b860-6a7ce1288e8d => generated 1280 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:29:14.079609 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-5b3bebe6-dd07-4843-844b-0883c6094834 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:14.087390 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-5b3bebe6-dd07-4843-844b-0883c6094834 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:14.088621 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-5b3bebe6-dd07-4843-844b-0883c6094834 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:14.335825 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-5416305e-d96c-4188-980b-0043e3b2258a tempest-DeleteServersTestJSON-823268338 tempest-DeleteServersTestJSON-823268338-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:29:14.336466 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-5416305e-d96c-4188-980b-0043e3b2258a tempest-DeleteServersTestJSON-823268338 tempest-DeleteServersTestJSON-823268338-project] [instance: 58790243-9fe3-49d2-b029-40825911ddde] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:29:14.352953 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-5416305e-d96c-4188-980b-0043e3b2258a tempest-DeleteServersTestJSON-823268338 tempest-DeleteServersTestJSON-823268338-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:14.352953 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-5416305e-d96c-4188-980b-0043e3b2258a tempest-DeleteServersTestJSON-823268338 tempest-DeleteServersTestJSON-823268338-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:14.352953 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-5416305e-d96c-4188-980b-0043e3b2258a tempest-DeleteServersTestJSON-823268338 tempest-DeleteServersTestJSON-823268338-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:14.352953 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-5416305e-d96c-4188-980b-0043e3b2258a tempest-DeleteServersTestJSON-823268338 tempest-DeleteServersTestJSON-823268338-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:15.689871 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-5b3bebe6-dd07-4843-844b-0883c6094834 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f6c755dbf74640a372802f02733eb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f0473c6214a4428be438fabc530012b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:29:15.704477 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-5b3bebe6-dd07-4843-844b-0883c6094834 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] 10.222.0.30 "GET /compute/v2.1/servers/121f052a-2d96-444d-a817-38e348aaf0e5" status: 200 len: 1368 microversion: 2.1 time: 1.654798 Jun 16 18:29:15.708656 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 35/73] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:29:14 2022] GET /compute/v2.1/servers/121f052a-2d96-444d-a817-38e348aaf0e5 => generated 1368 bytes in 1660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:29:15.726736 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-865f127a-219e-4c93-a55e-9fa13ca29d97 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:29:15.732019 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-865f127a-219e-4c93-a55e-9fa13ca29d97 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] [instance: 651b5fe1-0df7-4bc6-b18e-7caea544a93f] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:29:15.758087 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-865f127a-219e-4c93-a55e-9fa13ca29d97 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:15.758591 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-865f127a-219e-4c93-a55e-9fa13ca29d97 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:15.766020 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-865f127a-219e-4c93-a55e-9fa13ca29d97 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:15.767544 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-865f127a-219e-4c93-a55e-9fa13ca29d97 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:16.335811 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-5416305e-d96c-4188-980b-0043e3b2258a tempest-DeleteServersTestJSON-823268338 tempest-DeleteServersTestJSON-823268338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee9c06c774f478db33c16b784d6b914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa9111175cad44b2bbc611b7ae36a991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:29:16.396089 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-5416305e-d96c-4188-980b-0043e3b2258a tempest-DeleteServersTestJSON-823268338 tempest-DeleteServersTestJSON-823268338-project] 10.222.0.30 "GET /compute/v2.1/servers/58790243-9fe3-49d2-b029-40825911ddde" status: 200 len: 1314 microversion: 2.1 time: 2.063551 Jun 16 18:29:16.409613 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 39/74] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:29:14 2022] GET /compute/v2.1/servers/58790243-9fe3-49d2-b029-40825911ddde => generated 1314 bytes in 2078 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:29:16.500265 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-c3449697-a93b-45d6-aa49-1acf56aca9a9 tempest-VolumesNegativeTest-992612787 tempest-VolumesNegativeTest-992612787-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:29:16.512318 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-c3449697-a93b-45d6-aa49-1acf56aca9a9 tempest-VolumesNegativeTest-992612787 tempest-VolumesNegativeTest-992612787-project] [instance: b626d1e4-c5fd-47aa-be1f-4dbd8c2d50b5] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:29:16.569718 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-c3449697-a93b-45d6-aa49-1acf56aca9a9 tempest-VolumesNegativeTest-992612787 tempest-VolumesNegativeTest-992612787-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:16.572019 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-c3449697-a93b-45d6-aa49-1acf56aca9a9 tempest-VolumesNegativeTest-992612787 tempest-VolumesNegativeTest-992612787-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:16.574916 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-c3449697-a93b-45d6-aa49-1acf56aca9a9 tempest-VolumesNegativeTest-992612787 tempest-VolumesNegativeTest-992612787-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:16.578204 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-c3449697-a93b-45d6-aa49-1acf56aca9a9 tempest-VolumesNegativeTest-992612787 tempest-VolumesNegativeTest-992612787-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:17.128190 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-865f127a-219e-4c93-a55e-9fa13ca29d97 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:29:17.154266 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-865f127a-219e-4c93-a55e-9fa13ca29d97 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:29:17.158015 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-865f127a-219e-4c93-a55e-9fa13ca29d97 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:29:17.178763 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-865f127a-219e-4c93-a55e-9fa13ca29d97 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] 10.222.0.30 "GET /compute/v2.1/servers/651b5fe1-0df7-4bc6-b18e-7caea544a93f" status: 200 len: 1407 microversion: 2.20 time: 1.468683 Jun 16 18:29:17.193170 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 36/75] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Jun 16 18:29:15 2022] GET /compute/v2.1/servers/651b5fe1-0df7-4bc6-b18e-7caea544a93f => generated 1407 bytes in 1483 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:29:17.215663 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-02130e1a-e00a-40fb-9e07-3d7ad68ec275 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:29:17.225679 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-02130e1a-e00a-40fb-9e07-3d7ad68ec275 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] [instance: 05981bed-b625-4e9a-b860-6a7ce1288e8d] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:29:17.250664 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-02130e1a-e00a-40fb-9e07-3d7ad68ec275 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:17.251117 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-02130e1a-e00a-40fb-9e07-3d7ad68ec275 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:17.251914 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-02130e1a-e00a-40fb-9e07-3d7ad68ec275 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:17.252439 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-02130e1a-e00a-40fb-9e07-3d7ad68ec275 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:17.879515 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-c3449697-a93b-45d6-aa49-1acf56aca9a9 tempest-VolumesNegativeTest-992612787 tempest-VolumesNegativeTest-992612787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '479bda47e66544e8bfa47dad8294c180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '478dbeee61b6401c9dbb31c216ce537b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:29:17.900720 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-c3449697-a93b-45d6-aa49-1acf56aca9a9 tempest-VolumesNegativeTest-992612787 tempest-VolumesNegativeTest-992612787-project] 10.222.0.30 "GET /compute/v2.1/servers/b626d1e4-c5fd-47aa-be1f-4dbd8c2d50b5" status: 200 len: 1315 microversion: 2.1 time: 1.487009 Jun 16 18:29:17.901983 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 40/76] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:29:16 2022] GET /compute/v2.1/servers/b626d1e4-c5fd-47aa-be1f-4dbd8c2d50b5 => generated 1315 bytes in 1492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:29:17.982033 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [req-a904dc9a-58b5-4684-9b6c-62a224fcbd60 req-c431c660-1fae-4f98-8c85-dd3058cf2d08 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "58790243-9fe3-49d2-b029-40825911ddde", "tag": "be9e391a-a84f-495c-b209-129c97524123"}]} {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:29:17.997306 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [req-a904dc9a-58b5-4684-9b6c-62a224fcbd60 req-c431c660-1fae-4f98-8c85-dd3058cf2d08 service nova] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:17.998037 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [req-a904dc9a-58b5-4684-9b6c-62a224fcbd60 req-c431c660-1fae-4f98-8c85-dd3058cf2d08 service nova] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:18.022348 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.compute.server_external_events [req-a904dc9a-58b5-4684-9b6c-62a224fcbd60 req-c431c660-1fae-4f98-8c85-dd3058cf2d08 service nova] Creating event network-changed:be9e391a-a84f-495c-b209-129c97524123 for instance 58790243-9fe3-49d2-b029-40825911ddde on hv-cinder-81322 Jun 16 18:29:18.023179 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [req-a904dc9a-58b5-4684-9b6c-62a224fcbd60 req-c431c660-1fae-4f98-8c85-dd3058cf2d08 service nova] Acquired lock "compute-rpcapi-router" {{(pid=117670) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 16 18:29:18.024612 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-6f4de1ca-715f-4ef5-95d4-f25b2ce1421a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:18.025268 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-6f4de1ca-715f-4ef5-95d4-f25b2ce1421a None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:18.028000 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-6f4de1ca-715f-4ef5-95d4-f25b2ce1421a None None] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:18.028822 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-6f4de1ca-715f-4ef5-95d4-f25b2ce1421a None None] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:18.044436 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.compute.rpcapi [None req-6f4de1ca-715f-4ef5-95d4-f25b2ce1421a None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jun 16 18:29:18.045646 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-6f4de1ca-715f-4ef5-95d4-f25b2ce1421a None None] Releasing lock "compute-rpcapi-router" {{(pid=117670) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 16 18:29:18.078756 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-6f4de1ca-715f-4ef5-95d4-f25b2ce1421a None None] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.162295 Jun 16 18:29:18.082449 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 41/77] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Jun 16 18:29:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:29:18.097919 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-0eebd74e-9518-45e1-a01c-5dfb658b002c tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:29:18.099317 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-0eebd74e-9518-45e1-a01c-5dfb658b002c tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] [instance: 121f052a-2d96-444d-a817-38e348aaf0e5] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:29:18.121532 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-0eebd74e-9518-45e1-a01c-5dfb658b002c tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:18.122300 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-0eebd74e-9518-45e1-a01c-5dfb658b002c tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:18.123422 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-0eebd74e-9518-45e1-a01c-5dfb658b002c tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:18.124967 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-0eebd74e-9518-45e1-a01c-5dfb658b002c tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:18.461170 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-02130e1a-e00a-40fb-9e07-3d7ad68ec275 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512f01cca14b447c8f6c9eebbd828eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70bbccf07e3404cb94ba59201061a6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:29:18.471666 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-02130e1a-e00a-40fb-9e07-3d7ad68ec275 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] 10.222.0.30 "GET /compute/v2.1/servers/05981bed-b625-4e9a-b860-6a7ce1288e8d" status: 200 len: 1322 microversion: 2.1 time: 1.276066 Jun 16 18:29:18.472929 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 37/78] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:29:17 2022] GET /compute/v2.1/servers/05981bed-b625-4e9a-b860-6a7ce1288e8d => generated 1322 bytes in 1279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:29:18.478049 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-289fffa3-49eb-4763-8867-40aa388cd92b tempest-DeleteServersTestJSON-823268338 tempest-DeleteServersTestJSON-823268338-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:29:18.478948 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-289fffa3-49eb-4763-8867-40aa388cd92b tempest-DeleteServersTestJSON-823268338 tempest-DeleteServersTestJSON-823268338-project] [instance: 58790243-9fe3-49d2-b029-40825911ddde] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:29:18.487482 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-289fffa3-49eb-4763-8867-40aa388cd92b tempest-DeleteServersTestJSON-823268338 tempest-DeleteServersTestJSON-823268338-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:18.488258 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-289fffa3-49eb-4763-8867-40aa388cd92b tempest-DeleteServersTestJSON-823268338 tempest-DeleteServersTestJSON-823268338-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:18.489651 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-289fffa3-49eb-4763-8867-40aa388cd92b tempest-DeleteServersTestJSON-823268338 tempest-DeleteServersTestJSON-823268338-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:18.490289 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-289fffa3-49eb-4763-8867-40aa388cd92b tempest-DeleteServersTestJSON-823268338 tempest-DeleteServersTestJSON-823268338-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:18.896402 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-0eebd74e-9518-45e1-a01c-5dfb658b002c tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f6c755dbf74640a372802f02733eb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f0473c6214a4428be438fabc530012b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:29:18.909140 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-0eebd74e-9518-45e1-a01c-5dfb658b002c tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] 10.222.0.30 "GET /compute/v2.1/servers/121f052a-2d96-444d-a817-38e348aaf0e5" status: 200 len: 1368 microversion: 2.1 time: 0.824854 Jun 16 18:29:18.911049 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 42/79] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:29:18 2022] GET /compute/v2.1/servers/121f052a-2d96-444d-a817-38e348aaf0e5 => generated 1368 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:29:18.924463 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-54bb4470-be80-4fac-b3b1-f0e0117b6150 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:29:18.926477 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-54bb4470-be80-4fac-b3b1-f0e0117b6150 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] [instance: 651b5fe1-0df7-4bc6-b18e-7caea544a93f] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:29:18.939021 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-54bb4470-be80-4fac-b3b1-f0e0117b6150 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:18.940413 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-54bb4470-be80-4fac-b3b1-f0e0117b6150 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:18.942347 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-54bb4470-be80-4fac-b3b1-f0e0117b6150 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:18.943572 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-54bb4470-be80-4fac-b3b1-f0e0117b6150 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:19.148898 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-289fffa3-49eb-4763-8867-40aa388cd92b tempest-DeleteServersTestJSON-823268338 tempest-DeleteServersTestJSON-823268338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee9c06c774f478db33c16b784d6b914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa9111175cad44b2bbc611b7ae36a991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:29:19.170789 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-289fffa3-49eb-4763-8867-40aa388cd92b tempest-DeleteServersTestJSON-823268338 tempest-DeleteServersTestJSON-823268338-project] 10.222.0.30 "GET /compute/v2.1/servers/58790243-9fe3-49d2-b029-40825911ddde" status: 200 len: 1314 microversion: 2.1 time: 0.696558 Jun 16 18:29:19.171389 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 38/80] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:29:18 2022] GET /compute/v2.1/servers/58790243-9fe3-49d2-b029-40825911ddde => generated 1314 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:29:19.697320 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [req-9494e3b2-5be8-4313-bfac-5e3fe71552ab req-573c4a74-2444-44d3-adb9-c9f6e099979f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e541a8c3-c14c-46db-8b18-23fff07aa1d2", "tag": "88f4692a-7c46-4581-9664-8a005ca35a74"}]} {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:29:19.721597 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [req-9494e3b2-5be8-4313-bfac-5e3fe71552ab req-573c4a74-2444-44d3-adb9-c9f6e099979f service nova] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:19.722056 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [req-9494e3b2-5be8-4313-bfac-5e3fe71552ab req-573c4a74-2444-44d3-adb9-c9f6e099979f service nova] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:19.769213 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.compute.server_external_events [req-9494e3b2-5be8-4313-bfac-5e3fe71552ab req-573c4a74-2444-44d3-adb9-c9f6e099979f service nova] Creating event network-changed:88f4692a-7c46-4581-9664-8a005ca35a74 for instance e541a8c3-c14c-46db-8b18-23fff07aa1d2 on hv-cinder-81322 Jun 16 18:29:19.788165 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [req-9494e3b2-5be8-4313-bfac-5e3fe71552ab req-573c4a74-2444-44d3-adb9-c9f6e099979f service nova] Acquired lock "compute-rpcapi-router" {{(pid=117671) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 16 18:29:19.790576 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-e5348e5b-67c6-4b48-9a2b-cc79dafa29b8 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:19.791035 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-e5348e5b-67c6-4b48-9a2b-cc79dafa29b8 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:19.803620 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-e5348e5b-67c6-4b48-9a2b-cc79dafa29b8 None None] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:19.804343 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-e5348e5b-67c6-4b48-9a2b-cc79dafa29b8 None None] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:19.817040 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.compute.rpcapi [None req-e5348e5b-67c6-4b48-9a2b-cc79dafa29b8 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jun 16 18:29:19.818161 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-e5348e5b-67c6-4b48-9a2b-cc79dafa29b8 None None] Releasing lock "compute-rpcapi-router" {{(pid=117671) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 16 18:29:19.862744 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-e5348e5b-67c6-4b48-9a2b-cc79dafa29b8 None None] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.680627 Jun 16 18:29:19.863877 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 39/81] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Jun 16 18:29:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:29:19.871037 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-d2f7f95a-e753-4114-9550-06efea7f4927 tempest-VolumesNegativeTest-992612787 tempest-VolumesNegativeTest-992612787-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:29:19.872171 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-d2f7f95a-e753-4114-9550-06efea7f4927 tempest-VolumesNegativeTest-992612787 tempest-VolumesNegativeTest-992612787-project] [instance: b626d1e4-c5fd-47aa-be1f-4dbd8c2d50b5] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:29:19.883184 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-d2f7f95a-e753-4114-9550-06efea7f4927 tempest-VolumesNegativeTest-992612787 tempest-VolumesNegativeTest-992612787-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:19.884605 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-d2f7f95a-e753-4114-9550-06efea7f4927 tempest-VolumesNegativeTest-992612787 tempest-VolumesNegativeTest-992612787-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:19.890024 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-d2f7f95a-e753-4114-9550-06efea7f4927 tempest-VolumesNegativeTest-992612787 tempest-VolumesNegativeTest-992612787-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:19.890471 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-d2f7f95a-e753-4114-9550-06efea7f4927 tempest-VolumesNegativeTest-992612787 tempest-VolumesNegativeTest-992612787-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:20.380395 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-d2f7f95a-e753-4114-9550-06efea7f4927 tempest-VolumesNegativeTest-992612787 tempest-VolumesNegativeTest-992612787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '479bda47e66544e8bfa47dad8294c180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '478dbeee61b6401c9dbb31c216ce537b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:29:20.405711 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-d2f7f95a-e753-4114-9550-06efea7f4927 tempest-VolumesNegativeTest-992612787 tempest-VolumesNegativeTest-992612787-project] 10.222.0.30 "GET /compute/v2.1/servers/b626d1e4-c5fd-47aa-be1f-4dbd8c2d50b5" status: 200 len: 1315 microversion: 2.1 time: 0.536913 Jun 16 18:29:20.407438 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 40/82] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:29:19 2022] GET /compute/v2.1/servers/b626d1e4-c5fd-47aa-be1f-4dbd8c2d50b5 => generated 1315 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:29:20.442133 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-bdac54e7-30b1-4a43-8a11-f565a0de847d tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:29:20.443297 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-bdac54e7-30b1-4a43-8a11-f565a0de847d tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] [instance: 05981bed-b625-4e9a-b860-6a7ce1288e8d] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:29:20.465915 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-bdac54e7-30b1-4a43-8a11-f565a0de847d tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:20.466707 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-bdac54e7-30b1-4a43-8a11-f565a0de847d tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:20.469347 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-bdac54e7-30b1-4a43-8a11-f565a0de847d tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:20.470073 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-bdac54e7-30b1-4a43-8a11-f565a0de847d tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:20.556310 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-54bb4470-be80-4fac-b3b1-f0e0117b6150 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:29:20.590972 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-54bb4470-be80-4fac-b3b1-f0e0117b6150 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:29:20.609224 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-54bb4470-be80-4fac-b3b1-f0e0117b6150 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:29:20.611889 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-54bb4470-be80-4fac-b3b1-f0e0117b6150 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] 10.222.0.30 "GET /compute/v2.1/servers/651b5fe1-0df7-4bc6-b18e-7caea544a93f" status: 200 len: 1407 microversion: 2.20 time: 1.698247 Jun 16 18:29:20.613764 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 43/83] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Jun 16 18:29:18 2022] GET /compute/v2.1/servers/651b5fe1-0df7-4bc6-b18e-7caea544a93f => generated 1407 bytes in 1702 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:29:20.625940 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-13ef9dc4-b792-4b16-9bc1-9acdc383c1c9 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:29:20.636898 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-13ef9dc4-b792-4b16-9bc1-9acdc383c1c9 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] [instance: 121f052a-2d96-444d-a817-38e348aaf0e5] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:29:20.662565 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-13ef9dc4-b792-4b16-9bc1-9acdc383c1c9 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:20.663032 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-13ef9dc4-b792-4b16-9bc1-9acdc383c1c9 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:20.663849 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-13ef9dc4-b792-4b16-9bc1-9acdc383c1c9 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:20.664324 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-13ef9dc4-b792-4b16-9bc1-9acdc383c1c9 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:20.752590 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-bdac54e7-30b1-4a43-8a11-f565a0de847d tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512f01cca14b447c8f6c9eebbd828eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70bbccf07e3404cb94ba59201061a6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:29:20.771295 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-bdac54e7-30b1-4a43-8a11-f565a0de847d tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] 10.222.0.30 "GET /compute/v2.1/servers/05981bed-b625-4e9a-b860-6a7ce1288e8d" status: 200 len: 1322 microversion: 2.1 time: 0.361459 Jun 16 18:29:20.772911 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 41/84] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:29:20 2022] GET /compute/v2.1/servers/05981bed-b625-4e9a-b860-6a7ce1288e8d => generated 1322 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:29:20.782626 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-58f4ecac-e120-45c1-9bc5-d002c514318d tempest-DeleteServersTestJSON-823268338 tempest-DeleteServersTestJSON-823268338-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:29:20.784183 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-58f4ecac-e120-45c1-9bc5-d002c514318d tempest-DeleteServersTestJSON-823268338 tempest-DeleteServersTestJSON-823268338-project] [instance: 58790243-9fe3-49d2-b029-40825911ddde] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:29:20.800919 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-58f4ecac-e120-45c1-9bc5-d002c514318d tempest-DeleteServersTestJSON-823268338 tempest-DeleteServersTestJSON-823268338-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:20.802480 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-58f4ecac-e120-45c1-9bc5-d002c514318d tempest-DeleteServersTestJSON-823268338 tempest-DeleteServersTestJSON-823268338-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:20.804272 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-58f4ecac-e120-45c1-9bc5-d002c514318d tempest-DeleteServersTestJSON-823268338 tempest-DeleteServersTestJSON-823268338-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:20.805375 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-58f4ecac-e120-45c1-9bc5-d002c514318d tempest-DeleteServersTestJSON-823268338 tempest-DeleteServersTestJSON-823268338-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:21.152672 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-13ef9dc4-b792-4b16-9bc1-9acdc383c1c9 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f6c755dbf74640a372802f02733eb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f0473c6214a4428be438fabc530012b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:29:21.165814 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-13ef9dc4-b792-4b16-9bc1-9acdc383c1c9 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] 10.222.0.30 "GET /compute/v2.1/servers/121f052a-2d96-444d-a817-38e348aaf0e5" status: 200 len: 1368 microversion: 2.1 time: 0.550304 Jun 16 18:29:21.166552 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 44/85] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:29:20 2022] GET /compute/v2.1/servers/121f052a-2d96-444d-a817-38e348aaf0e5 => generated 1368 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:29:21.176488 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [req-d1f1a7aa-ba1d-422c-9295-451c4dd01461 req-09fea7c1-a6eb-4d9b-b943-28bf379fafaa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "121f052a-2d96-444d-a817-38e348aaf0e5", "tag": "0075a21e-8596-4b59-b394-0d2e2c21aab0"}, {"name": "network-changed", "server_uuid": "05981bed-b625-4e9a-b860-6a7ce1288e8d", "tag": "67e8bc05-0984-4a56-9695-39dbb5154e2d"}]} {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:29:21.218510 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [req-d1f1a7aa-ba1d-422c-9295-451c4dd01461 req-09fea7c1-a6eb-4d9b-b943-28bf379fafaa service nova] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:21.219550 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [req-d1f1a7aa-ba1d-422c-9295-451c4dd01461 req-09fea7c1-a6eb-4d9b-b943-28bf379fafaa service nova] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:21.228325 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-58f4ecac-e120-45c1-9bc5-d002c514318d tempest-DeleteServersTestJSON-823268338 tempest-DeleteServersTestJSON-823268338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee9c06c774f478db33c16b784d6b914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa9111175cad44b2bbc611b7ae36a991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:29:21.247372 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.compute.server_external_events [req-d1f1a7aa-ba1d-422c-9295-451c4dd01461 req-09fea7c1-a6eb-4d9b-b943-28bf379fafaa service nova] Creating event network-changed:0075a21e-8596-4b59-b394-0d2e2c21aab0 for instance 121f052a-2d96-444d-a817-38e348aaf0e5 on hv-cinder-81322 Jun 16 18:29:21.248638 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.compute.server_external_events [req-d1f1a7aa-ba1d-422c-9295-451c4dd01461 req-09fea7c1-a6eb-4d9b-b943-28bf379fafaa service nova] Creating event network-changed:67e8bc05-0984-4a56-9695-39dbb5154e2d for instance 05981bed-b625-4e9a-b860-6a7ce1288e8d on hv-cinder-81322 Jun 16 18:29:21.255180 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-58f4ecac-e120-45c1-9bc5-d002c514318d tempest-DeleteServersTestJSON-823268338 tempest-DeleteServersTestJSON-823268338-project] 10.222.0.30 "GET /compute/v2.1/servers/58790243-9fe3-49d2-b029-40825911ddde" status: 200 len: 1314 microversion: 2.1 time: 0.480129 Jun 16 18:29:21.256870 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 42/86] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:29:20 2022] GET /compute/v2.1/servers/58790243-9fe3-49d2-b029-40825911ddde => generated 1314 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:29:21.258160 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [req-d1f1a7aa-ba1d-422c-9295-451c4dd01461 req-09fea7c1-a6eb-4d9b-b943-28bf379fafaa service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.088457 Jun 16 18:29:21.259775 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 45/87] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Jun 16 18:29:21 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:29:21.450123 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-de128ceb-3431-4464-ab8a-b22904be51c6 tempest-VolumesNegativeTest-992612787 tempest-VolumesNegativeTest-992612787-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:29:21.452180 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-de128ceb-3431-4464-ab8a-b22904be51c6 tempest-VolumesNegativeTest-992612787 tempest-VolumesNegativeTest-992612787-project] [instance: b626d1e4-c5fd-47aa-be1f-4dbd8c2d50b5] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:29:21.470665 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-de128ceb-3431-4464-ab8a-b22904be51c6 tempest-VolumesNegativeTest-992612787 tempest-VolumesNegativeTest-992612787-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:21.472208 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-de128ceb-3431-4464-ab8a-b22904be51c6 tempest-VolumesNegativeTest-992612787 tempest-VolumesNegativeTest-992612787-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:21.474535 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-de128ceb-3431-4464-ab8a-b22904be51c6 tempest-VolumesNegativeTest-992612787 tempest-VolumesNegativeTest-992612787-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:21.476134 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-de128ceb-3431-4464-ab8a-b22904be51c6 tempest-VolumesNegativeTest-992612787 tempest-VolumesNegativeTest-992612787-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:21.648809 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-97659c3a-64cc-4e65-84b4-02741805b838 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:29:21.649460 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-97659c3a-64cc-4e65-84b4-02741805b838 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] [instance: 651b5fe1-0df7-4bc6-b18e-7caea544a93f] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:29:21.666439 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-97659c3a-64cc-4e65-84b4-02741805b838 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:21.672625 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-97659c3a-64cc-4e65-84b4-02741805b838 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:21.674101 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-97659c3a-64cc-4e65-84b4-02741805b838 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:21.675089 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-97659c3a-64cc-4e65-84b4-02741805b838 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:22.325357 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-97659c3a-64cc-4e65-84b4-02741805b838 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:29:22.361190 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-97659c3a-64cc-4e65-84b4-02741805b838 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:29:22.364786 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-97659c3a-64cc-4e65-84b4-02741805b838 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:29:22.368807 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-97659c3a-64cc-4e65-84b4-02741805b838 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] 10.222.0.30 "GET /compute/v2.1/servers/651b5fe1-0df7-4bc6-b18e-7caea544a93f" status: 200 len: 1407 microversion: 2.20 time: 0.725842 Jun 16 18:29:22.372231 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 46/88] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Jun 16 18:29:21 2022] GET /compute/v2.1/servers/651b5fe1-0df7-4bc6-b18e-7caea544a93f => generated 1407 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:29:22.377887 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-8f3093db-e3b4-4841-83a4-634120850706 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:29:22.379259 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-8f3093db-e3b4-4841-83a4-634120850706 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] [instance: 05981bed-b625-4e9a-b860-6a7ce1288e8d] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:29:22.388149 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-8f3093db-e3b4-4841-83a4-634120850706 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:22.389561 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-8f3093db-e3b4-4841-83a4-634120850706 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:22.390679 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-8f3093db-e3b4-4841-83a4-634120850706 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:22.391607 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-8f3093db-e3b4-4841-83a4-634120850706 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:22.482660 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-de128ceb-3431-4464-ab8a-b22904be51c6 tempest-VolumesNegativeTest-992612787 tempest-VolumesNegativeTest-992612787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '479bda47e66544e8bfa47dad8294c180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '478dbeee61b6401c9dbb31c216ce537b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:29:22.495348 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-de128ceb-3431-4464-ab8a-b22904be51c6 tempest-VolumesNegativeTest-992612787 tempest-VolumesNegativeTest-992612787-project] 10.222.0.30 "GET /compute/v2.1/servers/b626d1e4-c5fd-47aa-be1f-4dbd8c2d50b5" status: 200 len: 1315 microversion: 2.1 time: 1.062637 Jun 16 18:29:22.509665 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 43/89] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:29:21 2022] GET /compute/v2.1/servers/b626d1e4-c5fd-47aa-be1f-4dbd8c2d50b5 => generated 1315 bytes in 1079 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:29:22.516017 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [req-41c7f097-4126-4277-9994-ac13383f1bd1 req-8aea51dd-5c31-4f40-9d3b-9561835b3f49 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "651b5fe1-0df7-4bc6-b18e-7caea544a93f", "tag": "7416c7c3-1e79-4777-a950-c0c27847ca8e"}]} {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:29:22.530561 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [req-41c7f097-4126-4277-9994-ac13383f1bd1 req-8aea51dd-5c31-4f40-9d3b-9561835b3f49 service nova] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:22.531013 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [req-41c7f097-4126-4277-9994-ac13383f1bd1 req-8aea51dd-5c31-4f40-9d3b-9561835b3f49 service nova] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:22.548207 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.compute.server_external_events [req-41c7f097-4126-4277-9994-ac13383f1bd1 req-8aea51dd-5c31-4f40-9d3b-9561835b3f49 service nova] Creating event network-changed:7416c7c3-1e79-4777-a950-c0c27847ca8e for instance 651b5fe1-0df7-4bc6-b18e-7caea544a93f on hv-cinder-81322 Jun 16 18:29:22.565262 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [req-41c7f097-4126-4277-9994-ac13383f1bd1 req-8aea51dd-5c31-4f40-9d3b-9561835b3f49 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053435 Jun 16 18:29:22.566546 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 44/90] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Jun 16 18:29:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:29:22.574363 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-120658c8-0a7b-45c8-9e57-e78884d3a9d4 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:29:22.575554 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-120658c8-0a7b-45c8-9e57-e78884d3a9d4 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] [instance: 121f052a-2d96-444d-a817-38e348aaf0e5] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:29:22.583939 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-120658c8-0a7b-45c8-9e57-e78884d3a9d4 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:22.584676 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-120658c8-0a7b-45c8-9e57-e78884d3a9d4 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:22.585611 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-120658c8-0a7b-45c8-9e57-e78884d3a9d4 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:22.586220 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-120658c8-0a7b-45c8-9e57-e78884d3a9d4 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:22.760132 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-8f3093db-e3b4-4841-83a4-634120850706 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512f01cca14b447c8f6c9eebbd828eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70bbccf07e3404cb94ba59201061a6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:29:22.777935 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-8f3093db-e3b4-4841-83a4-634120850706 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] 10.222.0.30 "GET /compute/v2.1/servers/05981bed-b625-4e9a-b860-6a7ce1288e8d" status: 200 len: 1322 microversion: 2.1 time: 0.403594 Jun 16 18:29:22.779823 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 47/91] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:29:22 2022] GET /compute/v2.1/servers/05981bed-b625-4e9a-b860-6a7ce1288e8d => generated 1322 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:29:22.789458 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-22fc697d-e782-4a5e-aed0-dba06bb85365 tempest-DeleteServersTestJSON-823268338 tempest-DeleteServersTestJSON-823268338-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:29:22.791632 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-22fc697d-e782-4a5e-aed0-dba06bb85365 tempest-DeleteServersTestJSON-823268338 tempest-DeleteServersTestJSON-823268338-project] [instance: 58790243-9fe3-49d2-b029-40825911ddde] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:29:22.809764 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-22fc697d-e782-4a5e-aed0-dba06bb85365 tempest-DeleteServersTestJSON-823268338 tempest-DeleteServersTestJSON-823268338-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:22.810319 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-22fc697d-e782-4a5e-aed0-dba06bb85365 tempest-DeleteServersTestJSON-823268338 tempest-DeleteServersTestJSON-823268338-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:22.811230 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-22fc697d-e782-4a5e-aed0-dba06bb85365 tempest-DeleteServersTestJSON-823268338 tempest-DeleteServersTestJSON-823268338-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:22.811783 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-22fc697d-e782-4a5e-aed0-dba06bb85365 tempest-DeleteServersTestJSON-823268338 tempest-DeleteServersTestJSON-823268338-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:22.847211 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-120658c8-0a7b-45c8-9e57-e78884d3a9d4 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f6c755dbf74640a372802f02733eb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f0473c6214a4428be438fabc530012b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:29:22.856546 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-120658c8-0a7b-45c8-9e57-e78884d3a9d4 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] 10.222.0.30 "GET /compute/v2.1/servers/121f052a-2d96-444d-a817-38e348aaf0e5" status: 200 len: 1368 microversion: 2.1 time: 0.288352 Jun 16 18:29:22.869310 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 45/92] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:29:22 2022] GET /compute/v2.1/servers/121f052a-2d96-444d-a817-38e348aaf0e5 => generated 1368 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:29:22.995384 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-22fc697d-e782-4a5e-aed0-dba06bb85365 tempest-DeleteServersTestJSON-823268338 tempest-DeleteServersTestJSON-823268338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee9c06c774f478db33c16b784d6b914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa9111175cad44b2bbc611b7ae36a991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:29:23.004782 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-22fc697d-e782-4a5e-aed0-dba06bb85365 tempest-DeleteServersTestJSON-823268338 tempest-DeleteServersTestJSON-823268338-project] 10.222.0.30 "GET /compute/v2.1/servers/58790243-9fe3-49d2-b029-40825911ddde" status: 200 len: 1314 microversion: 2.1 time: 0.222969 Jun 16 18:29:23.005736 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 48/93] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:29:22 2022] GET /compute/v2.1/servers/58790243-9fe3-49d2-b029-40825911ddde => generated 1314 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:29:23.389909 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-e7086ea7-6105-42bc-931d-6baba1281552 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:29:23.391140 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-e7086ea7-6105-42bc-931d-6baba1281552 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] [instance: 651b5fe1-0df7-4bc6-b18e-7caea544a93f] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:29:23.400947 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-e7086ea7-6105-42bc-931d-6baba1281552 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:23.401866 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-e7086ea7-6105-42bc-931d-6baba1281552 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:23.402974 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-e7086ea7-6105-42bc-931d-6baba1281552 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:23.403793 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-e7086ea7-6105-42bc-931d-6baba1281552 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:23.534842 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-29d8d121-21b4-4f01-9adc-71165d5b0c83 tempest-VolumesNegativeTest-992612787 tempest-VolumesNegativeTest-992612787-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:29:23.536740 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-29d8d121-21b4-4f01-9adc-71165d5b0c83 tempest-VolumesNegativeTest-992612787 tempest-VolumesNegativeTest-992612787-project] [instance: b626d1e4-c5fd-47aa-be1f-4dbd8c2d50b5] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:29:23.550037 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-29d8d121-21b4-4f01-9adc-71165d5b0c83 tempest-VolumesNegativeTest-992612787 tempest-VolumesNegativeTest-992612787-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:23.551137 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-29d8d121-21b4-4f01-9adc-71165d5b0c83 tempest-VolumesNegativeTest-992612787 tempest-VolumesNegativeTest-992612787-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:23.552624 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-29d8d121-21b4-4f01-9adc-71165d5b0c83 tempest-VolumesNegativeTest-992612787 tempest-VolumesNegativeTest-992612787-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:23.563484 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-29d8d121-21b4-4f01-9adc-71165d5b0c83 tempest-VolumesNegativeTest-992612787 tempest-VolumesNegativeTest-992612787-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:23.602755 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-e7086ea7-6105-42bc-931d-6baba1281552 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:29:23.614789 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-e7086ea7-6105-42bc-931d-6baba1281552 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:29:23.617126 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-e7086ea7-6105-42bc-931d-6baba1281552 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:29:23.617925 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-e7086ea7-6105-42bc-931d-6baba1281552 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] 10.222.0.30 "GET /compute/v2.1/servers/651b5fe1-0df7-4bc6-b18e-7caea544a93f" status: 200 len: 1407 microversion: 2.20 time: 0.233802 Jun 16 18:29:23.632444 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 46/94] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Jun 16 18:29:23 2022] GET /compute/v2.1/servers/651b5fe1-0df7-4bc6-b18e-7caea544a93f => generated 1407 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:29:23.743288 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-29d8d121-21b4-4f01-9adc-71165d5b0c83 tempest-VolumesNegativeTest-992612787 tempest-VolumesNegativeTest-992612787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '479bda47e66544e8bfa47dad8294c180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '478dbeee61b6401c9dbb31c216ce537b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:29:23.753095 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-29d8d121-21b4-4f01-9adc-71165d5b0c83 tempest-VolumesNegativeTest-992612787 tempest-VolumesNegativeTest-992612787-project] 10.222.0.30 "GET /compute/v2.1/servers/b626d1e4-c5fd-47aa-be1f-4dbd8c2d50b5" status: 200 len: 1315 microversion: 2.1 time: 0.229270 Jun 16 18:29:23.753894 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 49/95] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:29:23 2022] GET /compute/v2.1/servers/b626d1e4-c5fd-47aa-be1f-4dbd8c2d50b5 => generated 1315 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:29:23.801952 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-0e79301c-e76c-43a0-ae57-532c3157fa4c tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:29:23.802652 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-0e79301c-e76c-43a0-ae57-532c3157fa4c tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] [instance: 05981bed-b625-4e9a-b860-6a7ce1288e8d] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:29:23.809717 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-0e79301c-e76c-43a0-ae57-532c3157fa4c tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:23.810167 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-0e79301c-e76c-43a0-ae57-532c3157fa4c tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:23.811221 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-0e79301c-e76c-43a0-ae57-532c3157fa4c tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:23.811663 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-0e79301c-e76c-43a0-ae57-532c3157fa4c tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:23.881038 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-6fbd8367-075c-468a-b0d1-a2425e7d76d4 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:29:23.883146 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-6fbd8367-075c-468a-b0d1-a2425e7d76d4 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] [instance: 121f052a-2d96-444d-a817-38e348aaf0e5] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:29:23.895369 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-6fbd8367-075c-468a-b0d1-a2425e7d76d4 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:23.895965 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-6fbd8367-075c-468a-b0d1-a2425e7d76d4 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:23.897290 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-6fbd8367-075c-468a-b0d1-a2425e7d76d4 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:23.898058 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-6fbd8367-075c-468a-b0d1-a2425e7d76d4 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:24.019669 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-0e79301c-e76c-43a0-ae57-532c3157fa4c tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512f01cca14b447c8f6c9eebbd828eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70bbccf07e3404cb94ba59201061a6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:29:24.029460 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-0e79301c-e76c-43a0-ae57-532c3157fa4c tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] 10.222.0.30 "GET /compute/v2.1/servers/05981bed-b625-4e9a-b860-6a7ce1288e8d" status: 200 len: 1322 microversion: 2.1 time: 0.231764 Jun 16 18:29:24.030320 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 47/96] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:29:23 2022] GET /compute/v2.1/servers/05981bed-b625-4e9a-b860-6a7ce1288e8d => generated 1322 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:29:24.036661 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-4a2b6545-f1f3-43eb-b7e7-f28270925b93 tempest-DeleteServersTestJSON-823268338 tempest-DeleteServersTestJSON-823268338-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:29:24.037618 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-4a2b6545-f1f3-43eb-b7e7-f28270925b93 tempest-DeleteServersTestJSON-823268338 tempest-DeleteServersTestJSON-823268338-project] [instance: 58790243-9fe3-49d2-b029-40825911ddde] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:29:24.048281 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-4a2b6545-f1f3-43eb-b7e7-f28270925b93 tempest-DeleteServersTestJSON-823268338 tempest-DeleteServersTestJSON-823268338-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:24.049001 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-4a2b6545-f1f3-43eb-b7e7-f28270925b93 tempest-DeleteServersTestJSON-823268338 tempest-DeleteServersTestJSON-823268338-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:24.049961 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-4a2b6545-f1f3-43eb-b7e7-f28270925b93 tempest-DeleteServersTestJSON-823268338 tempest-DeleteServersTestJSON-823268338-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:24.050528 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-4a2b6545-f1f3-43eb-b7e7-f28270925b93 tempest-DeleteServersTestJSON-823268338 tempest-DeleteServersTestJSON-823268338-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:24.126628 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-6fbd8367-075c-468a-b0d1-a2425e7d76d4 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f6c755dbf74640a372802f02733eb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f0473c6214a4428be438fabc530012b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:29:24.137508 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-6fbd8367-075c-468a-b0d1-a2425e7d76d4 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] 10.222.0.30 "GET /compute/v2.1/servers/121f052a-2d96-444d-a817-38e348aaf0e5" status: 200 len: 1368 microversion: 2.1 time: 0.263542 Jun 16 18:29:24.138837 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 50/97] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:29:23 2022] GET /compute/v2.1/servers/121f052a-2d96-444d-a817-38e348aaf0e5 => generated 1368 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:29:24.226112 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-4a2b6545-f1f3-43eb-b7e7-f28270925b93 tempest-DeleteServersTestJSON-823268338 tempest-DeleteServersTestJSON-823268338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee9c06c774f478db33c16b784d6b914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa9111175cad44b2bbc611b7ae36a991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:29:24.235445 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-4a2b6545-f1f3-43eb-b7e7-f28270925b93 tempest-DeleteServersTestJSON-823268338 tempest-DeleteServersTestJSON-823268338-project] 10.222.0.30 "GET /compute/v2.1/servers/58790243-9fe3-49d2-b029-40825911ddde" status: 200 len: 1314 microversion: 2.1 time: 0.203663 Jun 16 18:29:24.236378 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 48/98] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:29:24 2022] GET /compute/v2.1/servers/58790243-9fe3-49d2-b029-40825911ddde => generated 1314 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:29:24.594983 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [req-fb761d31-4f48-44e5-8832-cb94b56f35f6 req-8039010d-d6fc-4494-89cc-90ec5790e6ba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b626d1e4-c5fd-47aa-be1f-4dbd8c2d50b5", "tag": "e304be79-1d40-45f4-99ca-97459a28a681"}]} {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:29:24.605736 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [req-fb761d31-4f48-44e5-8832-cb94b56f35f6 req-8039010d-d6fc-4494-89cc-90ec5790e6ba service nova] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:24.606345 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [req-fb761d31-4f48-44e5-8832-cb94b56f35f6 req-8039010d-d6fc-4494-89cc-90ec5790e6ba service nova] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:24.627305 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.compute.server_external_events [req-fb761d31-4f48-44e5-8832-cb94b56f35f6 req-8039010d-d6fc-4494-89cc-90ec5790e6ba service nova] Creating event network-changed:e304be79-1d40-45f4-99ca-97459a28a681 for instance b626d1e4-c5fd-47aa-be1f-4dbd8c2d50b5 on hv-cinder-81322 Jun 16 18:29:24.636627 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [req-fb761d31-4f48-44e5-8832-cb94b56f35f6 req-8039010d-d6fc-4494-89cc-90ec5790e6ba service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044574 Jun 16 18:29:24.637958 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 51/99] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Jun 16 18:29:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 18:29:24.647251 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-a85e3f84-a9f4-4ced-b472-40a4514794f1 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:29:24.648133 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-a85e3f84-a9f4-4ced-b472-40a4514794f1 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] [instance: 651b5fe1-0df7-4bc6-b18e-7caea544a93f] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:29:24.657020 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-a85e3f84-a9f4-4ced-b472-40a4514794f1 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:24.657775 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-a85e3f84-a9f4-4ced-b472-40a4514794f1 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:24.659191 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-a85e3f84-a9f4-4ced-b472-40a4514794f1 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:24.659975 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-a85e3f84-a9f4-4ced-b472-40a4514794f1 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:24.774525 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-4870f01e-eeff-4677-8935-0dd5de21121c tempest-VolumesNegativeTest-992612787 tempest-VolumesNegativeTest-992612787-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:29:24.775233 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-4870f01e-eeff-4677-8935-0dd5de21121c tempest-VolumesNegativeTest-992612787 tempest-VolumesNegativeTest-992612787-project] [instance: b626d1e4-c5fd-47aa-be1f-4dbd8c2d50b5] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:29:24.787264 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-4870f01e-eeff-4677-8935-0dd5de21121c tempest-VolumesNegativeTest-992612787 tempest-VolumesNegativeTest-992612787-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:24.787727 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-4870f01e-eeff-4677-8935-0dd5de21121c tempest-VolumesNegativeTest-992612787 tempest-VolumesNegativeTest-992612787-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:24.788740 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-4870f01e-eeff-4677-8935-0dd5de21121c tempest-VolumesNegativeTest-992612787 tempest-VolumesNegativeTest-992612787-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:24.789335 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-4870f01e-eeff-4677-8935-0dd5de21121c tempest-VolumesNegativeTest-992612787 tempest-VolumesNegativeTest-992612787-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:24.893238 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-a85e3f84-a9f4-4ced-b472-40a4514794f1 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:29:24.912610 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-a85e3f84-a9f4-4ced-b472-40a4514794f1 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:29:24.917103 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-a85e3f84-a9f4-4ced-b472-40a4514794f1 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:29:24.921585 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-a85e3f84-a9f4-4ced-b472-40a4514794f1 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] 10.222.0.30 "GET /compute/v2.1/servers/651b5fe1-0df7-4bc6-b18e-7caea544a93f" status: 200 len: 1407 microversion: 2.20 time: 0.278223 Jun 16 18:29:24.923979 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 49/100] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Jun 16 18:29:24 2022] GET /compute/v2.1/servers/651b5fe1-0df7-4bc6-b18e-7caea544a93f => generated 1407 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:29:24.967198 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-4870f01e-eeff-4677-8935-0dd5de21121c tempest-VolumesNegativeTest-992612787 tempest-VolumesNegativeTest-992612787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '479bda47e66544e8bfa47dad8294c180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '478dbeee61b6401c9dbb31c216ce537b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:29:24.971182 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG dbcounter [-] [117670] Writing DB stats nova_cell1:SELECT=100 {{(pid=117670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:29:24.977816 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-4870f01e-eeff-4677-8935-0dd5de21121c tempest-VolumesNegativeTest-992612787 tempest-VolumesNegativeTest-992612787-project] 10.222.0.30 "GET /compute/v2.1/servers/b626d1e4-c5fd-47aa-be1f-4dbd8c2d50b5" status: 200 len: 1315 microversion: 2.1 time: 0.210616 Jun 16 18:29:24.978508 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 52/101] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:29:24 2022] GET /compute/v2.1/servers/b626d1e4-c5fd-47aa-be1f-4dbd8c2d50b5 => generated 1315 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:29:25.053992 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-f816c180-8ba9-4b55-b8ae-4ad8b3b18d99 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:29:25.056275 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-f816c180-8ba9-4b55-b8ae-4ad8b3b18d99 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] [instance: 05981bed-b625-4e9a-b860-6a7ce1288e8d] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:29:25.070898 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-f816c180-8ba9-4b55-b8ae-4ad8b3b18d99 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:25.073417 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-f816c180-8ba9-4b55-b8ae-4ad8b3b18d99 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:25.075849 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-f816c180-8ba9-4b55-b8ae-4ad8b3b18d99 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:25.077059 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-f816c180-8ba9-4b55-b8ae-4ad8b3b18d99 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:25.165690 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-9a995633-f991-4e89-8f63-15408f8ef0cd tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:29:25.166769 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-9a995633-f991-4e89-8f63-15408f8ef0cd tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] [instance: 121f052a-2d96-444d-a817-38e348aaf0e5] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:29:25.191295 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-9a995633-f991-4e89-8f63-15408f8ef0cd tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:25.192023 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-9a995633-f991-4e89-8f63-15408f8ef0cd tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:25.196697 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-9a995633-f991-4e89-8f63-15408f8ef0cd tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:25.197826 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-9a995633-f991-4e89-8f63-15408f8ef0cd tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:25.335411 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-f816c180-8ba9-4b55-b8ae-4ad8b3b18d99 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512f01cca14b447c8f6c9eebbd828eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70bbccf07e3404cb94ba59201061a6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:29:25.351142 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-f816c180-8ba9-4b55-b8ae-4ad8b3b18d99 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] 10.222.0.30 "GET /compute/v2.1/servers/05981bed-b625-4e9a-b860-6a7ce1288e8d" status: 200 len: 1322 microversion: 2.1 time: 0.304553 Jun 16 18:29:25.352245 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 50/102] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:29:25 2022] GET /compute/v2.1/servers/05981bed-b625-4e9a-b860-6a7ce1288e8d => generated 1322 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:29:25.362360 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-8abb236a-e61e-4d8f-a425-84b41b9279ca tempest-DeleteServersTestJSON-823268338 tempest-DeleteServersTestJSON-823268338-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:29:25.363481 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-8abb236a-e61e-4d8f-a425-84b41b9279ca tempest-DeleteServersTestJSON-823268338 tempest-DeleteServersTestJSON-823268338-project] [instance: 58790243-9fe3-49d2-b029-40825911ddde] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:29:25.374190 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-8abb236a-e61e-4d8f-a425-84b41b9279ca tempest-DeleteServersTestJSON-823268338 tempest-DeleteServersTestJSON-823268338-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:25.374853 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-8abb236a-e61e-4d8f-a425-84b41b9279ca tempest-DeleteServersTestJSON-823268338 tempest-DeleteServersTestJSON-823268338-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:25.375815 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-8abb236a-e61e-4d8f-a425-84b41b9279ca tempest-DeleteServersTestJSON-823268338 tempest-DeleteServersTestJSON-823268338-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:25.376437 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-8abb236a-e61e-4d8f-a425-84b41b9279ca tempest-DeleteServersTestJSON-823268338 tempest-DeleteServersTestJSON-823268338-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:25.381586 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG dbcounter [-] [117671] Writing DB stats nova_cell1:SELECT=100 {{(pid=117671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:29:25.452596 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-9a995633-f991-4e89-8f63-15408f8ef0cd tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f6c755dbf74640a372802f02733eb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f0473c6214a4428be438fabc530012b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:29:25.461580 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-9a995633-f991-4e89-8f63-15408f8ef0cd tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] 10.222.0.30 "GET /compute/v2.1/servers/121f052a-2d96-444d-a817-38e348aaf0e5" status: 200 len: 1368 microversion: 2.1 time: 0.302849 Jun 16 18:29:25.462170 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 53/103] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:29:25 2022] GET /compute/v2.1/servers/121f052a-2d96-444d-a817-38e348aaf0e5 => generated 1368 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:29:25.543257 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-8abb236a-e61e-4d8f-a425-84b41b9279ca tempest-DeleteServersTestJSON-823268338 tempest-DeleteServersTestJSON-823268338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee9c06c774f478db33c16b784d6b914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa9111175cad44b2bbc611b7ae36a991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:29:25.551876 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-8abb236a-e61e-4d8f-a425-84b41b9279ca tempest-DeleteServersTestJSON-823268338 tempest-DeleteServersTestJSON-823268338-project] 10.222.0.30 "GET /compute/v2.1/servers/58790243-9fe3-49d2-b029-40825911ddde" status: 200 len: 1314 microversion: 2.1 time: 0.197815 Jun 16 18:29:25.552661 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 51/104] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:29:25 2022] GET /compute/v2.1/servers/58790243-9fe3-49d2-b029-40825911ddde => generated 1314 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:29:25.942800 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-fd293fd7-eb9e-446f-bf61-34d7af4ffdd1 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:29:25.943415 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-fd293fd7-eb9e-446f-bf61-34d7af4ffdd1 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] [instance: 651b5fe1-0df7-4bc6-b18e-7caea544a93f] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:29:25.950964 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-fd293fd7-eb9e-446f-bf61-34d7af4ffdd1 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:25.951421 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-fd293fd7-eb9e-446f-bf61-34d7af4ffdd1 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:25.952266 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-fd293fd7-eb9e-446f-bf61-34d7af4ffdd1 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:25.952708 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-fd293fd7-eb9e-446f-bf61-34d7af4ffdd1 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:26.001085 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-2441dc0d-25e4-4aea-9bb5-487bdba8b346 tempest-VolumesNegativeTest-992612787 tempest-VolumesNegativeTest-992612787-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:29:26.002234 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-2441dc0d-25e4-4aea-9bb5-487bdba8b346 tempest-VolumesNegativeTest-992612787 tempest-VolumesNegativeTest-992612787-project] [instance: b626d1e4-c5fd-47aa-be1f-4dbd8c2d50b5] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:29:26.013794 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-2441dc0d-25e4-4aea-9bb5-487bdba8b346 tempest-VolumesNegativeTest-992612787 tempest-VolumesNegativeTest-992612787-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:26.014632 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-2441dc0d-25e4-4aea-9bb5-487bdba8b346 tempest-VolumesNegativeTest-992612787 tempest-VolumesNegativeTest-992612787-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:26.016019 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-2441dc0d-25e4-4aea-9bb5-487bdba8b346 tempest-VolumesNegativeTest-992612787 tempest-VolumesNegativeTest-992612787-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:26.016836 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-2441dc0d-25e4-4aea-9bb5-487bdba8b346 tempest-VolumesNegativeTest-992612787 tempest-VolumesNegativeTest-992612787-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:26.113119 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-fd293fd7-eb9e-446f-bf61-34d7af4ffdd1 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:29:26.122025 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-fd293fd7-eb9e-446f-bf61-34d7af4ffdd1 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:29:26.123632 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-fd293fd7-eb9e-446f-bf61-34d7af4ffdd1 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:29:26.124801 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-fd293fd7-eb9e-446f-bf61-34d7af4ffdd1 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] 10.222.0.30 "GET /compute/v2.1/servers/651b5fe1-0df7-4bc6-b18e-7caea544a93f" status: 200 len: 1407 microversion: 2.20 time: 0.185966 Jun 16 18:29:26.125375 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 54/105] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Jun 16 18:29:25 2022] GET /compute/v2.1/servers/651b5fe1-0df7-4bc6-b18e-7caea544a93f => generated 1407 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 18:29:26.246977 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-2441dc0d-25e4-4aea-9bb5-487bdba8b346 tempest-VolumesNegativeTest-992612787 tempest-VolumesNegativeTest-992612787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '479bda47e66544e8bfa47dad8294c180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '478dbeee61b6401c9dbb31c216ce537b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:29:26.255524 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-2441dc0d-25e4-4aea-9bb5-487bdba8b346 tempest-VolumesNegativeTest-992612787 tempest-VolumesNegativeTest-992612787-project] 10.222.0.30 "GET /compute/v2.1/servers/b626d1e4-c5fd-47aa-be1f-4dbd8c2d50b5" status: 200 len: 1315 microversion: 2.1 time: 0.262796 Jun 16 18:29:26.256217 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 52/106] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:29:25 2022] GET /compute/v2.1/servers/b626d1e4-c5fd-47aa-be1f-4dbd8c2d50b5 => generated 1315 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:29:26.371128 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-13b09d3d-35c5-4ccd-813d-9b5f44938f87 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:29:26.372529 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-13b09d3d-35c5-4ccd-813d-9b5f44938f87 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] [instance: 05981bed-b625-4e9a-b860-6a7ce1288e8d] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:29:26.379478 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-13b09d3d-35c5-4ccd-813d-9b5f44938f87 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:26.380122 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-13b09d3d-35c5-4ccd-813d-9b5f44938f87 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:26.381054 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-13b09d3d-35c5-4ccd-813d-9b5f44938f87 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:26.381652 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-13b09d3d-35c5-4ccd-813d-9b5f44938f87 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:26.492313 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-79882ded-7256-42ab-8217-1208fbc11f8c tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:29:26.493610 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-79882ded-7256-42ab-8217-1208fbc11f8c tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] [instance: 121f052a-2d96-444d-a817-38e348aaf0e5] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:29:26.505154 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-79882ded-7256-42ab-8217-1208fbc11f8c tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:26.505939 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-79882ded-7256-42ab-8217-1208fbc11f8c tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:26.507242 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-79882ded-7256-42ab-8217-1208fbc11f8c tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:26.508008 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-79882ded-7256-42ab-8217-1208fbc11f8c tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:26.572373 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-13b09d3d-35c5-4ccd-813d-9b5f44938f87 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512f01cca14b447c8f6c9eebbd828eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70bbccf07e3404cb94ba59201061a6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:29:26.586862 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-13b09d3d-35c5-4ccd-813d-9b5f44938f87 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] 10.222.0.30 "GET /compute/v2.1/servers/05981bed-b625-4e9a-b860-6a7ce1288e8d" status: 200 len: 1322 microversion: 2.1 time: 0.221573 Jun 16 18:29:26.587913 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 55/107] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:29:26 2022] GET /compute/v2.1/servers/05981bed-b625-4e9a-b860-6a7ce1288e8d => generated 1322 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:29:26.596663 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-0dc010b5-4eb4-4a98-a6e2-e3bf029015e7 tempest-DeleteServersTestJSON-823268338 tempest-DeleteServersTestJSON-823268338-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:29:26.597846 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-0dc010b5-4eb4-4a98-a6e2-e3bf029015e7 tempest-DeleteServersTestJSON-823268338 tempest-DeleteServersTestJSON-823268338-project] [instance: 58790243-9fe3-49d2-b029-40825911ddde] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:29:26.609690 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-0dc010b5-4eb4-4a98-a6e2-e3bf029015e7 tempest-DeleteServersTestJSON-823268338 tempest-DeleteServersTestJSON-823268338-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:26.610721 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-0dc010b5-4eb4-4a98-a6e2-e3bf029015e7 tempest-DeleteServersTestJSON-823268338 tempest-DeleteServersTestJSON-823268338-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:26.612505 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-0dc010b5-4eb4-4a98-a6e2-e3bf029015e7 tempest-DeleteServersTestJSON-823268338 tempest-DeleteServersTestJSON-823268338-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:26.613343 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-0dc010b5-4eb4-4a98-a6e2-e3bf029015e7 tempest-DeleteServersTestJSON-823268338 tempest-DeleteServersTestJSON-823268338-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:26.693989 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-79882ded-7256-42ab-8217-1208fbc11f8c tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f6c755dbf74640a372802f02733eb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f0473c6214a4428be438fabc530012b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:29:26.703480 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-79882ded-7256-42ab-8217-1208fbc11f8c tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] 10.222.0.30 "GET /compute/v2.1/servers/121f052a-2d96-444d-a817-38e348aaf0e5" status: 200 len: 1368 microversion: 2.1 time: 0.218998 Jun 16 18:29:26.704437 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 53/108] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:29:26 2022] GET /compute/v2.1/servers/121f052a-2d96-444d-a817-38e348aaf0e5 => generated 1368 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:29:26.805832 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-0dc010b5-4eb4-4a98-a6e2-e3bf029015e7 tempest-DeleteServersTestJSON-823268338 tempest-DeleteServersTestJSON-823268338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee9c06c774f478db33c16b784d6b914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa9111175cad44b2bbc611b7ae36a991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:29:26.824204 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-0dc010b5-4eb4-4a98-a6e2-e3bf029015e7 tempest-DeleteServersTestJSON-823268338 tempest-DeleteServersTestJSON-823268338-project] 10.222.0.30 "GET /compute/v2.1/servers/58790243-9fe3-49d2-b029-40825911ddde" status: 200 len: 1314 microversion: 2.1 time: 0.233749 Jun 16 18:29:26.825266 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 56/109] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:29:26 2022] GET /compute/v2.1/servers/58790243-9fe3-49d2-b029-40825911ddde => generated 1314 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:29:27.153739 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-79fd349a-792b-44b2-99c2-6d2e7a5c1330 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:29:27.154767 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-79fd349a-792b-44b2-99c2-6d2e7a5c1330 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] [instance: 651b5fe1-0df7-4bc6-b18e-7caea544a93f] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:29:27.161580 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-79fd349a-792b-44b2-99c2-6d2e7a5c1330 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:27.162197 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-79fd349a-792b-44b2-99c2-6d2e7a5c1330 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:27.163087 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-79fd349a-792b-44b2-99c2-6d2e7a5c1330 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:27.163615 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-79fd349a-792b-44b2-99c2-6d2e7a5c1330 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:27.274110 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-a96bfba2-2245-4b38-ae21-80049cbb9351 tempest-VolumesNegativeTest-992612787 tempest-VolumesNegativeTest-992612787-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:29:27.274764 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-a96bfba2-2245-4b38-ae21-80049cbb9351 tempest-VolumesNegativeTest-992612787 tempest-VolumesNegativeTest-992612787-project] [instance: b626d1e4-c5fd-47aa-be1f-4dbd8c2d50b5] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:29:27.285729 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-a96bfba2-2245-4b38-ae21-80049cbb9351 tempest-VolumesNegativeTest-992612787 tempest-VolumesNegativeTest-992612787-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:27.286785 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-a96bfba2-2245-4b38-ae21-80049cbb9351 tempest-VolumesNegativeTest-992612787 tempest-VolumesNegativeTest-992612787-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:27.288422 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-a96bfba2-2245-4b38-ae21-80049cbb9351 tempest-VolumesNegativeTest-992612787 tempest-VolumesNegativeTest-992612787-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:27.289224 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-a96bfba2-2245-4b38-ae21-80049cbb9351 tempest-VolumesNegativeTest-992612787 tempest-VolumesNegativeTest-992612787-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:27.325728 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-79fd349a-792b-44b2-99c2-6d2e7a5c1330 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:29:27.335648 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-79fd349a-792b-44b2-99c2-6d2e7a5c1330 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:29:27.337243 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-79fd349a-792b-44b2-99c2-6d2e7a5c1330 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:29:27.339071 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-79fd349a-792b-44b2-99c2-6d2e7a5c1330 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] 10.222.0.30 "GET /compute/v2.1/servers/651b5fe1-0df7-4bc6-b18e-7caea544a93f" status: 200 len: 1407 microversion: 2.20 time: 0.189433 Jun 16 18:29:27.339657 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 54/110] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Jun 16 18:29:27 2022] GET /compute/v2.1/servers/651b5fe1-0df7-4bc6-b18e-7caea544a93f => generated 1407 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:29:27.473841 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-a96bfba2-2245-4b38-ae21-80049cbb9351 tempest-VolumesNegativeTest-992612787 tempest-VolumesNegativeTest-992612787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '479bda47e66544e8bfa47dad8294c180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '478dbeee61b6401c9dbb31c216ce537b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:29:27.488320 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-a96bfba2-2245-4b38-ae21-80049cbb9351 tempest-VolumesNegativeTest-992612787 tempest-VolumesNegativeTest-992612787-project] 10.222.0.30 "GET /compute/v2.1/servers/b626d1e4-c5fd-47aa-be1f-4dbd8c2d50b5" status: 200 len: 1315 microversion: 2.1 time: 0.217777 Jun 16 18:29:27.489313 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 57/111] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:29:27 2022] GET /compute/v2.1/servers/b626d1e4-c5fd-47aa-be1f-4dbd8c2d50b5 => generated 1315 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:29:27.606080 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-9b0e00a3-68ac-450c-8bf5-02aaa9dc4865 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:29:27.606705 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-9b0e00a3-68ac-450c-8bf5-02aaa9dc4865 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] [instance: 05981bed-b625-4e9a-b860-6a7ce1288e8d] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:29:27.613131 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-9b0e00a3-68ac-450c-8bf5-02aaa9dc4865 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:27.613580 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-9b0e00a3-68ac-450c-8bf5-02aaa9dc4865 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:27.614360 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-9b0e00a3-68ac-450c-8bf5-02aaa9dc4865 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:27.614795 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-9b0e00a3-68ac-450c-8bf5-02aaa9dc4865 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:27.723245 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-9155b515-d5a4-4747-a16d-5c4a168bad89 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:29:27.724395 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-9155b515-d5a4-4747-a16d-5c4a168bad89 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] [instance: 121f052a-2d96-444d-a817-38e348aaf0e5] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:29:27.732606 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-9155b515-d5a4-4747-a16d-5c4a168bad89 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:27.733199 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-9155b515-d5a4-4747-a16d-5c4a168bad89 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:27.734072 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-9155b515-d5a4-4747-a16d-5c4a168bad89 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:27.734626 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-9155b515-d5a4-4747-a16d-5c4a168bad89 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:27.772288 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-9b0e00a3-68ac-450c-8bf5-02aaa9dc4865 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512f01cca14b447c8f6c9eebbd828eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70bbccf07e3404cb94ba59201061a6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:29:27.781205 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-9b0e00a3-68ac-450c-8bf5-02aaa9dc4865 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] 10.222.0.30 "GET /compute/v2.1/servers/05981bed-b625-4e9a-b860-6a7ce1288e8d" status: 200 len: 1322 microversion: 2.1 time: 0.180598 Jun 16 18:29:27.781796 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 55/112] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:29:27 2022] GET /compute/v2.1/servers/05981bed-b625-4e9a-b860-6a7ce1288e8d => generated 1322 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:29:27.844961 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-3bf34f47-4d17-4ec0-a2b6-987e4cebb68f tempest-DeleteServersTestJSON-823268338 tempest-DeleteServersTestJSON-823268338-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:29:27.846820 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-3bf34f47-4d17-4ec0-a2b6-987e4cebb68f tempest-DeleteServersTestJSON-823268338 tempest-DeleteServersTestJSON-823268338-project] [instance: 58790243-9fe3-49d2-b029-40825911ddde] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:29:27.859591 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-3bf34f47-4d17-4ec0-a2b6-987e4cebb68f tempest-DeleteServersTestJSON-823268338 tempest-DeleteServersTestJSON-823268338-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:27.861295 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-3bf34f47-4d17-4ec0-a2b6-987e4cebb68f tempest-DeleteServersTestJSON-823268338 tempest-DeleteServersTestJSON-823268338-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:27.862927 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-3bf34f47-4d17-4ec0-a2b6-987e4cebb68f tempest-DeleteServersTestJSON-823268338 tempest-DeleteServersTestJSON-823268338-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:27.863718 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-3bf34f47-4d17-4ec0-a2b6-987e4cebb68f tempest-DeleteServersTestJSON-823268338 tempest-DeleteServersTestJSON-823268338-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:27.927020 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-9155b515-d5a4-4747-a16d-5c4a168bad89 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f6c755dbf74640a372802f02733eb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f0473c6214a4428be438fabc530012b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:29:27.938774 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-9155b515-d5a4-4747-a16d-5c4a168bad89 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] 10.222.0.30 "GET /compute/v2.1/servers/121f052a-2d96-444d-a817-38e348aaf0e5" status: 200 len: 1368 microversion: 2.1 time: 0.219582 Jun 16 18:29:27.947407 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 58/113] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:29:27 2022] GET /compute/v2.1/servers/121f052a-2d96-444d-a817-38e348aaf0e5 => generated 1368 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:29:28.302276 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-3bf34f47-4d17-4ec0-a2b6-987e4cebb68f tempest-DeleteServersTestJSON-823268338 tempest-DeleteServersTestJSON-823268338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee9c06c774f478db33c16b784d6b914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa9111175cad44b2bbc611b7ae36a991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:29:28.314716 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-3bf34f47-4d17-4ec0-a2b6-987e4cebb68f tempest-DeleteServersTestJSON-823268338 tempest-DeleteServersTestJSON-823268338-project] 10.222.0.30 "GET /compute/v2.1/servers/58790243-9fe3-49d2-b029-40825911ddde" status: 200 len: 1314 microversion: 2.1 time: 0.475624 Jun 16 18:29:28.315342 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 56/114] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:29:27 2022] GET /compute/v2.1/servers/58790243-9fe3-49d2-b029-40825911ddde => generated 1314 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:29:28.376867 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-9c3d8a9e-bdb6-4b0b-8c48-d78b2b093790 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:29:28.381177 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-9c3d8a9e-bdb6-4b0b-8c48-d78b2b093790 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] [instance: 651b5fe1-0df7-4bc6-b18e-7caea544a93f] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:29:28.404348 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG dbcounter [-] [117670] Writing DB stats nova_cell0:SELECT=2 {{(pid=117670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:29:28.409163 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-9c3d8a9e-bdb6-4b0b-8c48-d78b2b093790 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:28.410387 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-9c3d8a9e-bdb6-4b0b-8c48-d78b2b093790 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:28.414504 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-9c3d8a9e-bdb6-4b0b-8c48-d78b2b093790 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:28.415683 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-9c3d8a9e-bdb6-4b0b-8c48-d78b2b093790 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:28.534646 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-0efef480-a5da-4e66-a282-34afb4825df0 tempest-VolumesNegativeTest-992612787 tempest-VolumesNegativeTest-992612787-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:29:28.545142 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-0efef480-a5da-4e66-a282-34afb4825df0 tempest-VolumesNegativeTest-992612787 tempest-VolumesNegativeTest-992612787-project] [instance: b626d1e4-c5fd-47aa-be1f-4dbd8c2d50b5] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:29:28.577470 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-0efef480-a5da-4e66-a282-34afb4825df0 tempest-VolumesNegativeTest-992612787 tempest-VolumesNegativeTest-992612787-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:28.578864 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-0efef480-a5da-4e66-a282-34afb4825df0 tempest-VolumesNegativeTest-992612787 tempest-VolumesNegativeTest-992612787-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:28.581086 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-0efef480-a5da-4e66-a282-34afb4825df0 tempest-VolumesNegativeTest-992612787 tempest-VolumesNegativeTest-992612787-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:28.584430 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-0efef480-a5da-4e66-a282-34afb4825df0 tempest-VolumesNegativeTest-992612787 tempest-VolumesNegativeTest-992612787-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:29.215374 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-0efef480-a5da-4e66-a282-34afb4825df0 tempest-VolumesNegativeTest-992612787 tempest-VolumesNegativeTest-992612787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '479bda47e66544e8bfa47dad8294c180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '478dbeee61b6401c9dbb31c216ce537b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:29:29.235405 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-0efef480-a5da-4e66-a282-34afb4825df0 tempest-VolumesNegativeTest-992612787 tempest-VolumesNegativeTest-992612787-project] 10.222.0.30 "GET /compute/v2.1/servers/b626d1e4-c5fd-47aa-be1f-4dbd8c2d50b5" status: 200 len: 1315 microversion: 2.1 time: 0.722125 Jun 16 18:29:29.238551 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 57/115] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:29:28 2022] GET /compute/v2.1/servers/b626d1e4-c5fd-47aa-be1f-4dbd8c2d50b5 => generated 1315 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:29:29.249820 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-a7691308-f7b3-4e92-ac95-10b8a9083d9e tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:29:29.251898 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-a7691308-f7b3-4e92-ac95-10b8a9083d9e tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] [instance: 05981bed-b625-4e9a-b860-6a7ce1288e8d] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:29:29.267389 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-a7691308-f7b3-4e92-ac95-10b8a9083d9e tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:29.269004 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-a7691308-f7b3-4e92-ac95-10b8a9083d9e tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:29.271165 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-a7691308-f7b3-4e92-ac95-10b8a9083d9e tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:29.272170 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-a7691308-f7b3-4e92-ac95-10b8a9083d9e tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:29.273234 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-9c3d8a9e-bdb6-4b0b-8c48-d78b2b093790 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:29:29.287317 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-9c3d8a9e-bdb6-4b0b-8c48-d78b2b093790 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:29:29.290436 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-9c3d8a9e-bdb6-4b0b-8c48-d78b2b093790 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:29:29.293061 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-9c3d8a9e-bdb6-4b0b-8c48-d78b2b093790 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] 10.222.0.30 "GET /compute/v2.1/servers/651b5fe1-0df7-4bc6-b18e-7caea544a93f" status: 200 len: 1407 microversion: 2.20 time: 0.927383 Jun 16 18:29:29.305359 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 59/116] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Jun 16 18:29:28 2022] GET /compute/v2.1/servers/651b5fe1-0df7-4bc6-b18e-7caea544a93f => generated 1407 bytes in 943 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:29:29.311985 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-4ed50f5e-ceb2-4498-b5fb-d324280924fd tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:29:29.313613 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-4ed50f5e-ceb2-4498-b5fb-d324280924fd tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] [instance: 121f052a-2d96-444d-a817-38e348aaf0e5] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:29:29.330239 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-4ed50f5e-ceb2-4498-b5fb-d324280924fd tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:29.330895 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-4ed50f5e-ceb2-4498-b5fb-d324280924fd tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:29.331760 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-4ed50f5e-ceb2-4498-b5fb-d324280924fd tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:29.333924 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-4ed50f5e-ceb2-4498-b5fb-d324280924fd tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:29.555273 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-a7691308-f7b3-4e92-ac95-10b8a9083d9e tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512f01cca14b447c8f6c9eebbd828eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70bbccf07e3404cb94ba59201061a6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:29:29.569198 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-4ed50f5e-ceb2-4498-b5fb-d324280924fd tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f6c755dbf74640a372802f02733eb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f0473c6214a4428be438fabc530012b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:29:29.582181 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-4ed50f5e-ceb2-4498-b5fb-d324280924fd tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] 10.222.0.30 "GET /compute/v2.1/servers/121f052a-2d96-444d-a817-38e348aaf0e5" status: 200 len: 1368 microversion: 2.1 time: 0.274755 Jun 16 18:29:29.591723 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 60/117] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:29:29 2022] GET /compute/v2.1/servers/121f052a-2d96-444d-a817-38e348aaf0e5 => generated 1368 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:29:29.592062 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-a7691308-f7b3-4e92-ac95-10b8a9083d9e tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] 10.222.0.30 "GET /compute/v2.1/servers/05981bed-b625-4e9a-b860-6a7ce1288e8d" status: 200 len: 1322 microversion: 2.1 time: 0.344739 Jun 16 18:29:29.592062 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 58/118] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:29:29 2022] GET /compute/v2.1/servers/05981bed-b625-4e9a-b860-6a7ce1288e8d => generated 1322 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:29:29.599336 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-7403a620-94e3-4a78-8605-d8e3f7c9a1a4 tempest-DeleteServersTestJSON-823268338 tempest-DeleteServersTestJSON-823268338-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:29:29.599336 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-7403a620-94e3-4a78-8605-d8e3f7c9a1a4 tempest-DeleteServersTestJSON-823268338 tempest-DeleteServersTestJSON-823268338-project] [instance: 58790243-9fe3-49d2-b029-40825911ddde] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:29:29.607040 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-7403a620-94e3-4a78-8605-d8e3f7c9a1a4 tempest-DeleteServersTestJSON-823268338 tempest-DeleteServersTestJSON-823268338-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:29.607855 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-7403a620-94e3-4a78-8605-d8e3f7c9a1a4 tempest-DeleteServersTestJSON-823268338 tempest-DeleteServersTestJSON-823268338-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:29.608738 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-7403a620-94e3-4a78-8605-d8e3f7c9a1a4 tempest-DeleteServersTestJSON-823268338 tempest-DeleteServersTestJSON-823268338-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:29.609759 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-7403a620-94e3-4a78-8605-d8e3f7c9a1a4 tempest-DeleteServersTestJSON-823268338 tempest-DeleteServersTestJSON-823268338-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:29.826233 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-7403a620-94e3-4a78-8605-d8e3f7c9a1a4 tempest-DeleteServersTestJSON-823268338 tempest-DeleteServersTestJSON-823268338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee9c06c774f478db33c16b784d6b914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa9111175cad44b2bbc611b7ae36a991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:29:29.839248 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-7403a620-94e3-4a78-8605-d8e3f7c9a1a4 tempest-DeleteServersTestJSON-823268338 tempest-DeleteServersTestJSON-823268338-project] 10.222.0.30 "GET /compute/v2.1/servers/58790243-9fe3-49d2-b029-40825911ddde" status: 200 len: 1314 microversion: 2.1 time: 0.254694 Jun 16 18:29:29.847392 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 61/119] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:29:29 2022] GET /compute/v2.1/servers/58790243-9fe3-49d2-b029-40825911ddde => generated 1314 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:29:30.263063 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-a0cde578-72ab-48b6-bbd4-f31db1927f6d tempest-VolumesNegativeTest-992612787 tempest-VolumesNegativeTest-992612787-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:29:30.267537 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-a0cde578-72ab-48b6-bbd4-f31db1927f6d tempest-VolumesNegativeTest-992612787 tempest-VolumesNegativeTest-992612787-project] [instance: b626d1e4-c5fd-47aa-be1f-4dbd8c2d50b5] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:29:30.273898 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG dbcounter [-] [117671] Writing DB stats nova_cell0:SELECT=2 {{(pid=117671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:29:30.291464 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-a0cde578-72ab-48b6-bbd4-f31db1927f6d tempest-VolumesNegativeTest-992612787 tempest-VolumesNegativeTest-992612787-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:30.293018 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-a0cde578-72ab-48b6-bbd4-f31db1927f6d tempest-VolumesNegativeTest-992612787 tempest-VolumesNegativeTest-992612787-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:30.294948 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-a0cde578-72ab-48b6-bbd4-f31db1927f6d tempest-VolumesNegativeTest-992612787 tempest-VolumesNegativeTest-992612787-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:30.296363 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-a0cde578-72ab-48b6-bbd4-f31db1927f6d tempest-VolumesNegativeTest-992612787 tempest-VolumesNegativeTest-992612787-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:30.320723 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-bc134565-f9ca-4f61-b1d8-3901f46d5664 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:29:30.322042 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-bc134565-f9ca-4f61-b1d8-3901f46d5664 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] [instance: 651b5fe1-0df7-4bc6-b18e-7caea544a93f] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:29:30.357101 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-bc134565-f9ca-4f61-b1d8-3901f46d5664 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:30.358322 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-bc134565-f9ca-4f61-b1d8-3901f46d5664 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:30.360086 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-bc134565-f9ca-4f61-b1d8-3901f46d5664 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:30.361290 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-bc134565-f9ca-4f61-b1d8-3901f46d5664 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:30.913169 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-a0cde578-72ab-48b6-bbd4-f31db1927f6d tempest-VolumesNegativeTest-992612787 tempest-VolumesNegativeTest-992612787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '479bda47e66544e8bfa47dad8294c180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '478dbeee61b6401c9dbb31c216ce537b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:29:30.950479 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-a0cde578-72ab-48b6-bbd4-f31db1927f6d tempest-VolumesNegativeTest-992612787 tempest-VolumesNegativeTest-992612787-project] 10.222.0.30 "GET /compute/v2.1/servers/b626d1e4-c5fd-47aa-be1f-4dbd8c2d50b5" status: 200 len: 1315 microversion: 2.1 time: 0.696068 Jun 16 18:29:30.954397 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 59/120] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:29:30 2022] GET /compute/v2.1/servers/b626d1e4-c5fd-47aa-be1f-4dbd8c2d50b5 => generated 1315 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:29:30.982023 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-3c72fdfb-10c7-46dc-ba53-b538b4e6cbea tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:29:30.985864 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-3c72fdfb-10c7-46dc-ba53-b538b4e6cbea tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] [instance: 121f052a-2d96-444d-a817-38e348aaf0e5] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:29:31.012845 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-3c72fdfb-10c7-46dc-ba53-b538b4e6cbea tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:31.016227 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-3c72fdfb-10c7-46dc-ba53-b538b4e6cbea tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:31.019072 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-3c72fdfb-10c7-46dc-ba53-b538b4e6cbea tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:31.021151 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-3c72fdfb-10c7-46dc-ba53-b538b4e6cbea tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:31.033995 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-bc134565-f9ca-4f61-b1d8-3901f46d5664 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:29:31.049844 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-bc134565-f9ca-4f61-b1d8-3901f46d5664 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:29:31.051494 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-bc134565-f9ca-4f61-b1d8-3901f46d5664 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:29:31.052684 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-bc134565-f9ca-4f61-b1d8-3901f46d5664 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] 10.222.0.30 "GET /compute/v2.1/servers/651b5fe1-0df7-4bc6-b18e-7caea544a93f" status: 200 len: 1407 microversion: 2.20 time: 0.743287 Jun 16 18:29:31.060069 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 62/121] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Jun 16 18:29:30 2022] GET /compute/v2.1/servers/651b5fe1-0df7-4bc6-b18e-7caea544a93f => generated 1407 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:29:31.069564 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-b8d5c3fe-18ac-43f2-b6cb-52f69d99a432 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:29:31.078790 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-b8d5c3fe-18ac-43f2-b6cb-52f69d99a432 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] [instance: 05981bed-b625-4e9a-b860-6a7ce1288e8d] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:29:31.101871 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-b8d5c3fe-18ac-43f2-b6cb-52f69d99a432 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:31.102988 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-b8d5c3fe-18ac-43f2-b6cb-52f69d99a432 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:31.104808 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-b8d5c3fe-18ac-43f2-b6cb-52f69d99a432 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:31.106413 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-b8d5c3fe-18ac-43f2-b6cb-52f69d99a432 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:31.404841 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-b8d5c3fe-18ac-43f2-b6cb-52f69d99a432 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512f01cca14b447c8f6c9eebbd828eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70bbccf07e3404cb94ba59201061a6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:29:31.414669 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-b8d5c3fe-18ac-43f2-b6cb-52f69d99a432 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] 10.222.0.30 "GET /compute/v2.1/servers/05981bed-b625-4e9a-b860-6a7ce1288e8d" status: 200 len: 1322 microversion: 2.1 time: 0.353019 Jun 16 18:29:31.415646 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 63/122] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:29:31 2022] GET /compute/v2.1/servers/05981bed-b625-4e9a-b860-6a7ce1288e8d => generated 1322 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:29:31.424787 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-036d44ef-fa17-4230-bc39-34da928d7bb6 tempest-DeleteServersTestJSON-823268338 tempest-DeleteServersTestJSON-823268338-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:29:31.426266 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-036d44ef-fa17-4230-bc39-34da928d7bb6 tempest-DeleteServersTestJSON-823268338 tempest-DeleteServersTestJSON-823268338-project] [instance: 58790243-9fe3-49d2-b029-40825911ddde] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:29:31.435337 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-036d44ef-fa17-4230-bc39-34da928d7bb6 tempest-DeleteServersTestJSON-823268338 tempest-DeleteServersTestJSON-823268338-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:31.436242 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-036d44ef-fa17-4230-bc39-34da928d7bb6 tempest-DeleteServersTestJSON-823268338 tempest-DeleteServersTestJSON-823268338-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:31.437518 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-036d44ef-fa17-4230-bc39-34da928d7bb6 tempest-DeleteServersTestJSON-823268338 tempest-DeleteServersTestJSON-823268338-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:31.438807 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-036d44ef-fa17-4230-bc39-34da928d7bb6 tempest-DeleteServersTestJSON-823268338 tempest-DeleteServersTestJSON-823268338-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:31.883219 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-036d44ef-fa17-4230-bc39-34da928d7bb6 tempest-DeleteServersTestJSON-823268338 tempest-DeleteServersTestJSON-823268338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee9c06c774f478db33c16b784d6b914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa9111175cad44b2bbc611b7ae36a991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:29:31.923328 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-036d44ef-fa17-4230-bc39-34da928d7bb6 tempest-DeleteServersTestJSON-823268338 tempest-DeleteServersTestJSON-823268338-project] 10.222.0.30 "GET /compute/v2.1/servers/58790243-9fe3-49d2-b029-40825911ddde" status: 200 len: 1314 microversion: 2.1 time: 0.494542 Jun 16 18:29:31.936295 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 64/123] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:29:31 2022] GET /compute/v2.1/servers/58790243-9fe3-49d2-b029-40825911ddde => generated 1314 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:29:31.957645 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-3c72fdfb-10c7-46dc-ba53-b538b4e6cbea tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f6c755dbf74640a372802f02733eb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f0473c6214a4428be438fabc530012b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:29:31.983962 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-4ae647bf-782a-41bf-8902-20724357826b tempest-VolumesNegativeTest-992612787 tempest-VolumesNegativeTest-992612787-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:29:31.985105 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-4ae647bf-782a-41bf-8902-20724357826b tempest-VolumesNegativeTest-992612787 tempest-VolumesNegativeTest-992612787-project] [instance: b626d1e4-c5fd-47aa-be1f-4dbd8c2d50b5] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:29:31.995768 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-3c72fdfb-10c7-46dc-ba53-b538b4e6cbea tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] 10.222.0.30 "GET /compute/v2.1/servers/121f052a-2d96-444d-a817-38e348aaf0e5" status: 200 len: 1368 microversion: 2.1 time: 1.034549 Jun 16 18:29:32.002045 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-4ae647bf-782a-41bf-8902-20724357826b tempest-VolumesNegativeTest-992612787 tempest-VolumesNegativeTest-992612787-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:32.004600 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-4ae647bf-782a-41bf-8902-20724357826b tempest-VolumesNegativeTest-992612787 tempest-VolumesNegativeTest-992612787-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:32.009757 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-4ae647bf-782a-41bf-8902-20724357826b tempest-VolumesNegativeTest-992612787 tempest-VolumesNegativeTest-992612787-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:32.010354 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-4ae647bf-782a-41bf-8902-20724357826b tempest-VolumesNegativeTest-992612787 tempest-VolumesNegativeTest-992612787-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:32.018189 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 60/124] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:29:30 2022] GET /compute/v2.1/servers/121f052a-2d96-444d-a817-38e348aaf0e5 => generated 1368 bytes in 1042 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:29:32.113630 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-196c7f9b-d52b-4c8c-89bb-0e7ffa4887bd tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:29:32.123125 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-196c7f9b-d52b-4c8c-89bb-0e7ffa4887bd tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] [instance: 651b5fe1-0df7-4bc6-b18e-7caea544a93f] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:29:32.133501 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG dbcounter [-] [117671] Writing DB stats nova_api:SELECT=76 {{(pid=117671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:29:32.175855 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-196c7f9b-d52b-4c8c-89bb-0e7ffa4887bd tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:32.179561 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-196c7f9b-d52b-4c8c-89bb-0e7ffa4887bd tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:32.188154 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-196c7f9b-d52b-4c8c-89bb-0e7ffa4887bd tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:32.188154 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-196c7f9b-d52b-4c8c-89bb-0e7ffa4887bd tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:32.426836 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-196c7f9b-d52b-4c8c-89bb-0e7ffa4887bd tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:29:32.456264 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-196c7f9b-d52b-4c8c-89bb-0e7ffa4887bd tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:29:32.460973 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-196c7f9b-d52b-4c8c-89bb-0e7ffa4887bd tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:29:32.465601 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-196c7f9b-d52b-4c8c-89bb-0e7ffa4887bd tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] 10.222.0.30 "GET /compute/v2.1/servers/651b5fe1-0df7-4bc6-b18e-7caea544a93f" status: 200 len: 1407 microversion: 2.20 time: 0.361070 Jun 16 18:29:32.467109 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 61/125] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Jun 16 18:29:32 2022] GET /compute/v2.1/servers/651b5fe1-0df7-4bc6-b18e-7caea544a93f => generated 1407 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 18:29:32.507276 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-4ae647bf-782a-41bf-8902-20724357826b tempest-VolumesNegativeTest-992612787 tempest-VolumesNegativeTest-992612787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '479bda47e66544e8bfa47dad8294c180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '478dbeee61b6401c9dbb31c216ce537b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:29:32.519800 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-4ae647bf-782a-41bf-8902-20724357826b tempest-VolumesNegativeTest-992612787 tempest-VolumesNegativeTest-992612787-project] 10.222.0.30 "GET /compute/v2.1/servers/b626d1e4-c5fd-47aa-be1f-4dbd8c2d50b5" status: 200 len: 1315 microversion: 2.1 time: 0.540738 Jun 16 18:29:32.532595 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 65/126] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:29:31 2022] GET /compute/v2.1/servers/b626d1e4-c5fd-47aa-be1f-4dbd8c2d50b5 => generated 1315 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:29:32.543451 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-5301c348-10d6-4020-a6e1-2bc14c8446ce tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:29:32.546663 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-5301c348-10d6-4020-a6e1-2bc14c8446ce tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] [instance: 05981bed-b625-4e9a-b860-6a7ce1288e8d] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:29:32.552974 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG dbcounter [-] [117670] Writing DB stats nova_api:SELECT=75 {{(pid=117670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:29:32.565397 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-5301c348-10d6-4020-a6e1-2bc14c8446ce tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:32.567559 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-5301c348-10d6-4020-a6e1-2bc14c8446ce tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:32.568576 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-5301c348-10d6-4020-a6e1-2bc14c8446ce tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:32.569636 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-5301c348-10d6-4020-a6e1-2bc14c8446ce tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:32.643699 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [req-2f91c726-8ad6-450e-b10b-5fb6b3422e5a req-a1f08551-9aae-4492-9708-f8589246d3fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "121f052a-2d96-444d-a817-38e348aaf0e5", "name": "network-vif-plugged", "status": "completed", "tag": "0075a21e-8596-4b59-b394-0d2e2c21aab0"}]} {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:29:32.661067 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [req-2f91c726-8ad6-450e-b10b-5fb6b3422e5a req-a1f08551-9aae-4492-9708-f8589246d3fe service nova] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:32.662185 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [req-2f91c726-8ad6-450e-b10b-5fb6b3422e5a req-a1f08551-9aae-4492-9708-f8589246d3fe service nova] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:32.686763 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.compute.server_external_events [req-2f91c726-8ad6-450e-b10b-5fb6b3422e5a req-a1f08551-9aae-4492-9708-f8589246d3fe service nova] Creating event network-vif-plugged:0075a21e-8596-4b59-b394-0d2e2c21aab0 for instance 121f052a-2d96-444d-a817-38e348aaf0e5 on hv-cinder-81322 Jun 16 18:29:32.701869 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [req-2f91c726-8ad6-450e-b10b-5fb6b3422e5a req-a1f08551-9aae-4492-9708-f8589246d3fe service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.227573 Jun 16 18:29:32.701869 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 62/127] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Jun 16 18:29:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:29:32.950827 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-4369910a-0321-485d-983f-84f76c5ad515 tempest-DeleteServersTestJSON-823268338 tempest-DeleteServersTestJSON-823268338-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:29:32.951620 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-4369910a-0321-485d-983f-84f76c5ad515 tempest-DeleteServersTestJSON-823268338 tempest-DeleteServersTestJSON-823268338-project] [instance: 58790243-9fe3-49d2-b029-40825911ddde] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:29:32.986620 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-4369910a-0321-485d-983f-84f76c5ad515 tempest-DeleteServersTestJSON-823268338 tempest-DeleteServersTestJSON-823268338-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:32.987859 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-4369910a-0321-485d-983f-84f76c5ad515 tempest-DeleteServersTestJSON-823268338 tempest-DeleteServersTestJSON-823268338-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:32.991057 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-4369910a-0321-485d-983f-84f76c5ad515 tempest-DeleteServersTestJSON-823268338 tempest-DeleteServersTestJSON-823268338-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:32.998528 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-4369910a-0321-485d-983f-84f76c5ad515 tempest-DeleteServersTestJSON-823268338 tempest-DeleteServersTestJSON-823268338-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:33.175792 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-5301c348-10d6-4020-a6e1-2bc14c8446ce tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512f01cca14b447c8f6c9eebbd828eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70bbccf07e3404cb94ba59201061a6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:29:33.183883 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-5301c348-10d6-4020-a6e1-2bc14c8446ce tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] 10.222.0.30 "GET /compute/v2.1/servers/05981bed-b625-4e9a-b860-6a7ce1288e8d" status: 200 len: 1322 microversion: 2.1 time: 0.649949 Jun 16 18:29:33.196462 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 66/128] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:29:32 2022] GET /compute/v2.1/servers/05981bed-b625-4e9a-b860-6a7ce1288e8d => generated 1322 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:29:33.203364 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-db623b7d-7628-4d2d-b06f-8333ddc0b6be tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:29:33.204393 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-db623b7d-7628-4d2d-b06f-8333ddc0b6be tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] [instance: 121f052a-2d96-444d-a817-38e348aaf0e5] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:29:33.219798 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-db623b7d-7628-4d2d-b06f-8333ddc0b6be tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:33.220580 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-db623b7d-7628-4d2d-b06f-8333ddc0b6be tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:33.221375 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-db623b7d-7628-4d2d-b06f-8333ddc0b6be tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:33.221825 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-db623b7d-7628-4d2d-b06f-8333ddc0b6be tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:33.594736 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-4369910a-0321-485d-983f-84f76c5ad515 tempest-DeleteServersTestJSON-823268338 tempest-DeleteServersTestJSON-823268338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee9c06c774f478db33c16b784d6b914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa9111175cad44b2bbc611b7ae36a991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:29:33.624457 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-4369910a-0321-485d-983f-84f76c5ad515 tempest-DeleteServersTestJSON-823268338 tempest-DeleteServersTestJSON-823268338-project] 10.222.0.30 "GET /compute/v2.1/servers/58790243-9fe3-49d2-b029-40825911ddde" status: 200 len: 1314 microversion: 2.1 time: 0.684796 Jun 16 18:29:33.640978 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 63/129] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:29:32 2022] GET /compute/v2.1/servers/58790243-9fe3-49d2-b029-40825911ddde => generated 1314 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:29:33.654672 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-d4e8a96b-5c75-456a-8d72-bb6bfc9afca2 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:29:33.656340 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-d4e8a96b-5c75-456a-8d72-bb6bfc9afca2 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] [instance: 651b5fe1-0df7-4bc6-b18e-7caea544a93f] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:29:33.672037 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-d4e8a96b-5c75-456a-8d72-bb6bfc9afca2 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:33.679913 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-d4e8a96b-5c75-456a-8d72-bb6bfc9afca2 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:33.681498 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-d4e8a96b-5c75-456a-8d72-bb6bfc9afca2 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:33.682843 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-d4e8a96b-5c75-456a-8d72-bb6bfc9afca2 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:34.084140 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-db623b7d-7628-4d2d-b06f-8333ddc0b6be tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f6c755dbf74640a372802f02733eb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f0473c6214a4428be438fabc530012b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:29:34.106060 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-db623b7d-7628-4d2d-b06f-8333ddc0b6be tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] 10.222.0.30 "GET /compute/v2.1/servers/121f052a-2d96-444d-a817-38e348aaf0e5" status: 200 len: 1368 microversion: 2.1 time: 0.904909 Jun 16 18:29:34.106735 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 67/130] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:29:33 2022] GET /compute/v2.1/servers/121f052a-2d96-444d-a817-38e348aaf0e5 => generated 1368 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:29:34.130237 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-8e51c231-b1ec-4334-85d1-1a9e83357308 tempest-VolumesNegativeTest-992612787 tempest-VolumesNegativeTest-992612787-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:29:34.130968 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-8e51c231-b1ec-4334-85d1-1a9e83357308 tempest-VolumesNegativeTest-992612787 tempest-VolumesNegativeTest-992612787-project] [instance: b626d1e4-c5fd-47aa-be1f-4dbd8c2d50b5] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:29:34.148028 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-8e51c231-b1ec-4334-85d1-1a9e83357308 tempest-VolumesNegativeTest-992612787 tempest-VolumesNegativeTest-992612787-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:34.148516 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-8e51c231-b1ec-4334-85d1-1a9e83357308 tempest-VolumesNegativeTest-992612787 tempest-VolumesNegativeTest-992612787-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:34.149343 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-8e51c231-b1ec-4334-85d1-1a9e83357308 tempest-VolumesNegativeTest-992612787 tempest-VolumesNegativeTest-992612787-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:34.149788 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-8e51c231-b1ec-4334-85d1-1a9e83357308 tempest-VolumesNegativeTest-992612787 tempest-VolumesNegativeTest-992612787-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:34.157736 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-d4e8a96b-5c75-456a-8d72-bb6bfc9afca2 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:29:34.175010 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-d4e8a96b-5c75-456a-8d72-bb6bfc9afca2 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:29:34.177672 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-d4e8a96b-5c75-456a-8d72-bb6bfc9afca2 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:29:34.179759 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-d4e8a96b-5c75-456a-8d72-bb6bfc9afca2 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] 10.222.0.30 "GET /compute/v2.1/servers/651b5fe1-0df7-4bc6-b18e-7caea544a93f" status: 200 len: 1407 microversion: 2.20 time: 0.537201 Jun 16 18:29:34.186552 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 64/131] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Jun 16 18:29:33 2022] GET /compute/v2.1/servers/651b5fe1-0df7-4bc6-b18e-7caea544a93f => generated 1407 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:29:34.207820 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-7c1e0daa-9c2a-4bb1-9c3d-1eebf84aec89 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:29:34.208487 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-7c1e0daa-9c2a-4bb1-9c3d-1eebf84aec89 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] [instance: 05981bed-b625-4e9a-b860-6a7ce1288e8d] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:29:34.219382 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-7c1e0daa-9c2a-4bb1-9c3d-1eebf84aec89 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:34.219837 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-7c1e0daa-9c2a-4bb1-9c3d-1eebf84aec89 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:34.220681 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-7c1e0daa-9c2a-4bb1-9c3d-1eebf84aec89 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:34.221129 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-7c1e0daa-9c2a-4bb1-9c3d-1eebf84aec89 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:34.515153 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-7c1e0daa-9c2a-4bb1-9c3d-1eebf84aec89 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512f01cca14b447c8f6c9eebbd828eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70bbccf07e3404cb94ba59201061a6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:29:34.533588 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-7c1e0daa-9c2a-4bb1-9c3d-1eebf84aec89 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] 10.222.0.30 "GET /compute/v2.1/servers/05981bed-b625-4e9a-b860-6a7ce1288e8d" status: 200 len: 1322 microversion: 2.1 time: 0.329545 Jun 16 18:29:34.535005 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 65/132] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:29:34 2022] GET /compute/v2.1/servers/05981bed-b625-4e9a-b860-6a7ce1288e8d => generated 1322 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:29:34.663529 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-0605c927-2771-4a0b-9a3e-8dfd926cca1f tempest-DeleteServersTestJSON-823268338 tempest-DeleteServersTestJSON-823268338-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:29:34.665542 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-0605c927-2771-4a0b-9a3e-8dfd926cca1f tempest-DeleteServersTestJSON-823268338 tempest-DeleteServersTestJSON-823268338-project] [instance: 58790243-9fe3-49d2-b029-40825911ddde] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:29:34.679638 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-0605c927-2771-4a0b-9a3e-8dfd926cca1f tempest-DeleteServersTestJSON-823268338 tempest-DeleteServersTestJSON-823268338-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:34.680637 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-0605c927-2771-4a0b-9a3e-8dfd926cca1f tempest-DeleteServersTestJSON-823268338 tempest-DeleteServersTestJSON-823268338-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:34.682192 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-0605c927-2771-4a0b-9a3e-8dfd926cca1f tempest-DeleteServersTestJSON-823268338 tempest-DeleteServersTestJSON-823268338-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:34.683385 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-0605c927-2771-4a0b-9a3e-8dfd926cca1f tempest-DeleteServersTestJSON-823268338 tempest-DeleteServersTestJSON-823268338-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:34.770807 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-8e51c231-b1ec-4334-85d1-1a9e83357308 tempest-VolumesNegativeTest-992612787 tempest-VolumesNegativeTest-992612787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '479bda47e66544e8bfa47dad8294c180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '478dbeee61b6401c9dbb31c216ce537b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:29:34.780187 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-8e51c231-b1ec-4334-85d1-1a9e83357308 tempest-VolumesNegativeTest-992612787 tempest-VolumesNegativeTest-992612787-project] 10.222.0.30 "GET /compute/v2.1/servers/b626d1e4-c5fd-47aa-be1f-4dbd8c2d50b5" status: 200 len: 1315 microversion: 2.1 time: 0.660855 Jun 16 18:29:34.781450 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 68/133] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:29:34 2022] GET /compute/v2.1/servers/b626d1e4-c5fd-47aa-be1f-4dbd8c2d50b5 => generated 1315 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:29:34.786826 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [req-408105d8-d964-49fe-8bc5-8bac88a98890 req-0d5596b3-adfe-400a-ade5-38713a27b2cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58790243-9fe3-49d2-b029-40825911ddde", "name": "network-vif-plugged", "status": "completed", "tag": "be9e391a-a84f-495c-b209-129c97524123"}]} {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:29:34.796760 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [req-408105d8-d964-49fe-8bc5-8bac88a98890 req-0d5596b3-adfe-400a-ade5-38713a27b2cc service nova] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:34.797519 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [req-408105d8-d964-49fe-8bc5-8bac88a98890 req-0d5596b3-adfe-400a-ade5-38713a27b2cc service nova] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:34.814870 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.compute.server_external_events [req-408105d8-d964-49fe-8bc5-8bac88a98890 req-0d5596b3-adfe-400a-ade5-38713a27b2cc service nova] Creating event network-vif-plugged:be9e391a-a84f-495c-b209-129c97524123 for instance 58790243-9fe3-49d2-b029-40825911ddde on hv-cinder-81322 Jun 16 18:29:34.821726 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [req-408105d8-d964-49fe-8bc5-8bac88a98890 req-0d5596b3-adfe-400a-ade5-38713a27b2cc service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038746 Jun 16 18:29:34.824283 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 69/134] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Jun 16 18:29:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:29:34.997798 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-0605c927-2771-4a0b-9a3e-8dfd926cca1f tempest-DeleteServersTestJSON-823268338 tempest-DeleteServersTestJSON-823268338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee9c06c774f478db33c16b784d6b914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa9111175cad44b2bbc611b7ae36a991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:29:35.014516 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-0605c927-2771-4a0b-9a3e-8dfd926cca1f tempest-DeleteServersTestJSON-823268338 tempest-DeleteServersTestJSON-823268338-project] 10.222.0.30 "GET /compute/v2.1/servers/58790243-9fe3-49d2-b029-40825911ddde" status: 200 len: 1314 microversion: 2.1 time: 0.357791 Jun 16 18:29:35.015915 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 66/135] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:29:34 2022] GET /compute/v2.1/servers/58790243-9fe3-49d2-b029-40825911ddde => generated 1314 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:29:35.127533 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-d6133131-a49c-4eca-92a2-0c852f41f5a9 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:29:35.130717 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-d6133131-a49c-4eca-92a2-0c852f41f5a9 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] [instance: 121f052a-2d96-444d-a817-38e348aaf0e5] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:29:35.141969 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-d6133131-a49c-4eca-92a2-0c852f41f5a9 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:35.142781 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-d6133131-a49c-4eca-92a2-0c852f41f5a9 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:35.144085 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-d6133131-a49c-4eca-92a2-0c852f41f5a9 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:35.144866 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-d6133131-a49c-4eca-92a2-0c852f41f5a9 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:35.154709 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG dbcounter [-] [117670] Writing DB stats nova_cell1:SELECT=100 {{(pid=117670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:29:35.210456 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-b71ae8fb-dd52-4aaf-8746-d452c1a1fa3b tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:29:35.211588 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-b71ae8fb-dd52-4aaf-8746-d452c1a1fa3b tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] [instance: 651b5fe1-0df7-4bc6-b18e-7caea544a93f] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:29:35.240998 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-b71ae8fb-dd52-4aaf-8746-d452c1a1fa3b tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:35.241796 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-b71ae8fb-dd52-4aaf-8746-d452c1a1fa3b tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:35.243241 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-b71ae8fb-dd52-4aaf-8746-d452c1a1fa3b tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:35.244016 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-b71ae8fb-dd52-4aaf-8746-d452c1a1fa3b tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:35.845065 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-d6133131-a49c-4eca-92a2-0c852f41f5a9 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f6c755dbf74640a372802f02733eb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f0473c6214a4428be438fabc530012b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:29:35.883875 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-d6133131-a49c-4eca-92a2-0c852f41f5a9 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] 10.222.0.30 "GET /compute/v2.1/servers/121f052a-2d96-444d-a817-38e348aaf0e5" status: 200 len: 1368 microversion: 2.1 time: 0.762449 Jun 16 18:29:35.888607 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-b71ae8fb-dd52-4aaf-8746-d452c1a1fa3b tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:29:35.902049 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 70/136] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:29:35 2022] GET /compute/v2.1/servers/121f052a-2d96-444d-a817-38e348aaf0e5 => generated 1368 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:29:35.926196 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-7d47b9f4-d300-4122-96f1-a0affeda31e5 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:29:35.928994 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-b71ae8fb-dd52-4aaf-8746-d452c1a1fa3b tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:29:35.934308 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-7d47b9f4-d300-4122-96f1-a0affeda31e5 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] [instance: 05981bed-b625-4e9a-b860-6a7ce1288e8d] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:29:35.940035 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-b71ae8fb-dd52-4aaf-8746-d452c1a1fa3b tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:29:35.942191 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-b71ae8fb-dd52-4aaf-8746-d452c1a1fa3b tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] 10.222.0.30 "GET /compute/v2.1/servers/651b5fe1-0df7-4bc6-b18e-7caea544a93f" status: 200 len: 1407 microversion: 2.20 time: 0.741477 Jun 16 18:29:35.944223 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 67/137] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Jun 16 18:29:35 2022] GET /compute/v2.1/servers/651b5fe1-0df7-4bc6-b18e-7caea544a93f => generated 1407 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 18:29:35.958033 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-7d47b9f4-d300-4122-96f1-a0affeda31e5 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:35.958830 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-7d47b9f4-d300-4122-96f1-a0affeda31e5 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:35.962617 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-55cb7214-e00c-499e-9a1a-da826d5c648f tempest-VolumesNegativeTest-992612787 tempest-VolumesNegativeTest-992612787-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:29:35.964840 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-55cb7214-e00c-499e-9a1a-da826d5c648f tempest-VolumesNegativeTest-992612787 tempest-VolumesNegativeTest-992612787-project] [instance: b626d1e4-c5fd-47aa-be1f-4dbd8c2d50b5] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:29:35.965377 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-7d47b9f4-d300-4122-96f1-a0affeda31e5 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:35.967649 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-7d47b9f4-d300-4122-96f1-a0affeda31e5 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:35.997469 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-55cb7214-e00c-499e-9a1a-da826d5c648f tempest-VolumesNegativeTest-992612787 tempest-VolumesNegativeTest-992612787-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:35.998002 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-55cb7214-e00c-499e-9a1a-da826d5c648f tempest-VolumesNegativeTest-992612787 tempest-VolumesNegativeTest-992612787-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:35.998896 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-55cb7214-e00c-499e-9a1a-da826d5c648f tempest-VolumesNegativeTest-992612787 tempest-VolumesNegativeTest-992612787-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:35.999358 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-55cb7214-e00c-499e-9a1a-da826d5c648f tempest-VolumesNegativeTest-992612787 tempest-VolumesNegativeTest-992612787-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:36.043957 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG dbcounter [-] [117671] Writing DB stats nova_cell1:SELECT=100 {{(pid=117671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:29:36.286836 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-7d47b9f4-d300-4122-96f1-a0affeda31e5 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512f01cca14b447c8f6c9eebbd828eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70bbccf07e3404cb94ba59201061a6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:29:36.297361 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-7d47b9f4-d300-4122-96f1-a0affeda31e5 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] 10.222.0.30 "GET /compute/v2.1/servers/05981bed-b625-4e9a-b860-6a7ce1288e8d" status: 200 len: 1322 microversion: 2.1 time: 0.388827 Jun 16 18:29:36.309296 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 71/138] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:29:35 2022] GET /compute/v2.1/servers/05981bed-b625-4e9a-b860-6a7ce1288e8d => generated 1322 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:29:36.314564 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-13f88f00-8215-4e36-895b-d4c1ced5dc8d tempest-DeleteServersTestJSON-823268338 tempest-DeleteServersTestJSON-823268338-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:29:36.315576 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-13f88f00-8215-4e36-895b-d4c1ced5dc8d tempest-DeleteServersTestJSON-823268338 tempest-DeleteServersTestJSON-823268338-project] [instance: 58790243-9fe3-49d2-b029-40825911ddde] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:29:36.323899 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-55cb7214-e00c-499e-9a1a-da826d5c648f tempest-VolumesNegativeTest-992612787 tempest-VolumesNegativeTest-992612787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '479bda47e66544e8bfa47dad8294c180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '478dbeee61b6401c9dbb31c216ce537b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:29:36.332752 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-55cb7214-e00c-499e-9a1a-da826d5c648f tempest-VolumesNegativeTest-992612787 tempest-VolumesNegativeTest-992612787-project] 10.222.0.30 "GET /compute/v2.1/servers/b626d1e4-c5fd-47aa-be1f-4dbd8c2d50b5" status: 200 len: 1315 microversion: 2.1 time: 0.386591 Jun 16 18:29:36.342465 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-13f88f00-8215-4e36-895b-d4c1ced5dc8d tempest-DeleteServersTestJSON-823268338 tempest-DeleteServersTestJSON-823268338-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:36.343354 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 68/139] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:29:35 2022] GET /compute/v2.1/servers/b626d1e4-c5fd-47aa-be1f-4dbd8c2d50b5 => generated 1315 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:29:36.344074 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-13f88f00-8215-4e36-895b-d4c1ced5dc8d tempest-DeleteServersTestJSON-823268338 tempest-DeleteServersTestJSON-823268338-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:36.345661 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-13f88f00-8215-4e36-895b-d4c1ced5dc8d tempest-DeleteServersTestJSON-823268338 tempest-DeleteServersTestJSON-823268338-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:36.346723 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-13f88f00-8215-4e36-895b-d4c1ced5dc8d tempest-DeleteServersTestJSON-823268338 tempest-DeleteServersTestJSON-823268338-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:36.689645 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-13f88f00-8215-4e36-895b-d4c1ced5dc8d tempest-DeleteServersTestJSON-823268338 tempest-DeleteServersTestJSON-823268338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee9c06c774f478db33c16b784d6b914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa9111175cad44b2bbc611b7ae36a991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:29:36.699582 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-13f88f00-8215-4e36-895b-d4c1ced5dc8d tempest-DeleteServersTestJSON-823268338 tempest-DeleteServersTestJSON-823268338-project] 10.222.0.30 "GET /compute/v2.1/servers/58790243-9fe3-49d2-b029-40825911ddde" status: 200 len: 1314 microversion: 2.1 time: 0.388745 Jun 16 18:29:36.700202 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 72/140] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:29:36 2022] GET /compute/v2.1/servers/58790243-9fe3-49d2-b029-40825911ddde => generated 1314 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:29:36.898650 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [req-79ed96b9-939e-4ca1-861e-67f713ae0082 req-3cf2a227-08b6-45a7-aca7-6eed02509cf0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "05981bed-b625-4e9a-b860-6a7ce1288e8d", "name": "network-vif-plugged", "status": "completed", "tag": "67e8bc05-0984-4a56-9695-39dbb5154e2d"}, {"server_uuid": "e541a8c3-c14c-46db-8b18-23fff07aa1d2", "name": "network-vif-plugged", "status": "completed", "tag": "88f4692a-7c46-4581-9664-8a005ca35a74"}]} {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:29:36.911981 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [req-79ed96b9-939e-4ca1-861e-67f713ae0082 req-3cf2a227-08b6-45a7-aca7-6eed02509cf0 service nova] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:36.912509 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [req-79ed96b9-939e-4ca1-861e-67f713ae0082 req-3cf2a227-08b6-45a7-aca7-6eed02509cf0 service nova] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:36.925103 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-24731a69-29e1-4160-8635-bb52d0b6877f tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:29:36.926252 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-24731a69-29e1-4160-8635-bb52d0b6877f tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] [instance: 121f052a-2d96-444d-a817-38e348aaf0e5] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:29:36.927893 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.compute.server_external_events [req-79ed96b9-939e-4ca1-861e-67f713ae0082 req-3cf2a227-08b6-45a7-aca7-6eed02509cf0 service nova] Creating event network-vif-plugged:67e8bc05-0984-4a56-9695-39dbb5154e2d for instance 05981bed-b625-4e9a-b860-6a7ce1288e8d on hv-cinder-81322 Jun 16 18:29:36.928443 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.compute.server_external_events [req-79ed96b9-939e-4ca1-861e-67f713ae0082 req-3cf2a227-08b6-45a7-aca7-6eed02509cf0 service nova] Creating event network-vif-plugged:88f4692a-7c46-4581-9664-8a005ca35a74 for instance e541a8c3-c14c-46db-8b18-23fff07aa1d2 on hv-cinder-81322 Jun 16 18:29:36.936565 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [req-79ed96b9-939e-4ca1-861e-67f713ae0082 req-3cf2a227-08b6-45a7-aca7-6eed02509cf0 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.041266 Jun 16 18:29:36.937939 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 69/141] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Jun 16 18:29:36 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:29:36.940751 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-24731a69-29e1-4160-8635-bb52d0b6877f tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:36.941553 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-24731a69-29e1-4160-8635-bb52d0b6877f tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:36.943319 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-24731a69-29e1-4160-8635-bb52d0b6877f tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:36.944390 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-24731a69-29e1-4160-8635-bb52d0b6877f tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:36.969096 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-f9170326-1daa-4e72-bba4-336e31eb996e tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:29:36.970301 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-f9170326-1daa-4e72-bba4-336e31eb996e tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] [instance: 651b5fe1-0df7-4bc6-b18e-7caea544a93f] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:29:36.982773 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-f9170326-1daa-4e72-bba4-336e31eb996e tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:36.984093 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-f9170326-1daa-4e72-bba4-336e31eb996e tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:36.985486 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-f9170326-1daa-4e72-bba4-336e31eb996e tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:36.986266 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-f9170326-1daa-4e72-bba4-336e31eb996e tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:37.202146 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-24731a69-29e1-4160-8635-bb52d0b6877f tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f6c755dbf74640a372802f02733eb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f0473c6214a4428be438fabc530012b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:29:37.212997 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-24731a69-29e1-4160-8635-bb52d0b6877f tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] 10.222.0.30 "GET /compute/v2.1/servers/121f052a-2d96-444d-a817-38e348aaf0e5" status: 200 len: 1558 microversion: 2.1 time: 0.294531 Jun 16 18:29:37.214490 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 73/142] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:29:36 2022] GET /compute/v2.1/servers/121f052a-2d96-444d-a817-38e348aaf0e5 => generated 1558 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:29:37.237062 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-4d426ad1-cda3-44a9-bf06-51c58600fc85 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:29:37.237654 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-4d426ad1-cda3-44a9-bf06-51c58600fc85 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] [instance: 121f052a-2d96-444d-a817-38e348aaf0e5] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:29:37.245303 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-4d426ad1-cda3-44a9-bf06-51c58600fc85 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:37.246264 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-4d426ad1-cda3-44a9-bf06-51c58600fc85 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:37.247582 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-f9170326-1daa-4e72-bba4-336e31eb996e tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:29:37.247946 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-4d426ad1-cda3-44a9-bf06-51c58600fc85 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:37.248618 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-4d426ad1-cda3-44a9-bf06-51c58600fc85 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:37.263491 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-f9170326-1daa-4e72-bba4-336e31eb996e tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:29:37.266144 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-f9170326-1daa-4e72-bba4-336e31eb996e tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:29:37.268021 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-f9170326-1daa-4e72-bba4-336e31eb996e tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] 10.222.0.30 "GET /compute/v2.1/servers/651b5fe1-0df7-4bc6-b18e-7caea544a93f" status: 200 len: 1407 microversion: 2.20 time: 0.304507 Jun 16 18:29:37.269084 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 70/143] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Jun 16 18:29:36 2022] GET /compute/v2.1/servers/651b5fe1-0df7-4bc6-b18e-7caea544a93f => generated 1407 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:29:37.340568 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-7fa777e9-4617-4fd7-9ca8-beaedbaa39df tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:29:37.342706 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-7fa777e9-4617-4fd7-9ca8-beaedbaa39df tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] [instance: 05981bed-b625-4e9a-b860-6a7ce1288e8d] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:29:37.353082 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-7fa777e9-4617-4fd7-9ca8-beaedbaa39df tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:37.354039 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-7fa777e9-4617-4fd7-9ca8-beaedbaa39df tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:37.355014 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-7fa777e9-4617-4fd7-9ca8-beaedbaa39df tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:37.356144 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-7fa777e9-4617-4fd7-9ca8-beaedbaa39df tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:37.414053 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-4d426ad1-cda3-44a9-bf06-51c58600fc85 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] 10.222.0.30 "GET /compute/v2.1/servers/121f052a-2d96-444d-a817-38e348aaf0e5/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.181275 Jun 16 18:29:37.415425 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 74/144] 10.222.0.30 () {58 vars in 1274 bytes} [Thu Jun 16 18:29:37 2022] GET /compute/v2.1/servers/121f052a-2d96-444d-a817-38e348aaf0e5/os-interface => generated 285 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 18:29:37.424795 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-48759085-90a3-4ded-874d-7e4059d383b2 tempest-VolumesNegativeTest-992612787 tempest-VolumesNegativeTest-992612787-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:29:37.426427 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-48759085-90a3-4ded-874d-7e4059d383b2 tempest-VolumesNegativeTest-992612787 tempest-VolumesNegativeTest-992612787-project] [instance: b626d1e4-c5fd-47aa-be1f-4dbd8c2d50b5] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:29:37.441091 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-48759085-90a3-4ded-874d-7e4059d383b2 tempest-VolumesNegativeTest-992612787 tempest-VolumesNegativeTest-992612787-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:37.442134 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-48759085-90a3-4ded-874d-7e4059d383b2 tempest-VolumesNegativeTest-992612787 tempest-VolumesNegativeTest-992612787-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:37.443639 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-48759085-90a3-4ded-874d-7e4059d383b2 tempest-VolumesNegativeTest-992612787 tempest-VolumesNegativeTest-992612787-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:37.444575 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-48759085-90a3-4ded-874d-7e4059d383b2 tempest-VolumesNegativeTest-992612787 tempest-VolumesNegativeTest-992612787-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:37.710375 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-48759085-90a3-4ded-874d-7e4059d383b2 tempest-VolumesNegativeTest-992612787 tempest-VolumesNegativeTest-992612787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '479bda47e66544e8bfa47dad8294c180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '478dbeee61b6401c9dbb31c216ce537b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:29:37.725056 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-48759085-90a3-4ded-874d-7e4059d383b2 tempest-VolumesNegativeTest-992612787 tempest-VolumesNegativeTest-992612787-project] 10.222.0.30 "GET /compute/v2.1/servers/b626d1e4-c5fd-47aa-be1f-4dbd8c2d50b5" status: 200 len: 1315 microversion: 2.1 time: 0.307218 Jun 16 18:29:37.726069 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 75/145] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:29:37 2022] GET /compute/v2.1/servers/b626d1e4-c5fd-47aa-be1f-4dbd8c2d50b5 => generated 1315 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:29:37.743247 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-bd036e58-5003-4497-8fc8-82c911e65487 tempest-DeleteServersTestJSON-823268338 tempest-DeleteServersTestJSON-823268338-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:29:37.745270 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-bd036e58-5003-4497-8fc8-82c911e65487 tempest-DeleteServersTestJSON-823268338 tempest-DeleteServersTestJSON-823268338-project] [instance: 58790243-9fe3-49d2-b029-40825911ddde] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:29:37.757788 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-bd036e58-5003-4497-8fc8-82c911e65487 tempest-DeleteServersTestJSON-823268338 tempest-DeleteServersTestJSON-823268338-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:37.759185 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-bd036e58-5003-4497-8fc8-82c911e65487 tempest-DeleteServersTestJSON-823268338 tempest-DeleteServersTestJSON-823268338-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:37.761571 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-bd036e58-5003-4497-8fc8-82c911e65487 tempest-DeleteServersTestJSON-823268338 tempest-DeleteServersTestJSON-823268338-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:37.762089 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-bd036e58-5003-4497-8fc8-82c911e65487 tempest-DeleteServersTestJSON-823268338 tempest-DeleteServersTestJSON-823268338-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:37.934875 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-7fa777e9-4617-4fd7-9ca8-beaedbaa39df tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512f01cca14b447c8f6c9eebbd828eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70bbccf07e3404cb94ba59201061a6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:29:37.950040 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-7fa777e9-4617-4fd7-9ca8-beaedbaa39df tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] 10.222.0.30 "GET /compute/v2.1/servers/05981bed-b625-4e9a-b860-6a7ce1288e8d" status: 200 len: 1322 microversion: 2.1 time: 0.615582 Jun 16 18:29:37.951727 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 71/146] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:29:37 2022] GET /compute/v2.1/servers/05981bed-b625-4e9a-b860-6a7ce1288e8d => generated 1322 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:29:38.013902 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-bd036e58-5003-4497-8fc8-82c911e65487 tempest-DeleteServersTestJSON-823268338 tempest-DeleteServersTestJSON-823268338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee9c06c774f478db33c16b784d6b914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa9111175cad44b2bbc611b7ae36a991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:29:38.023151 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-bd036e58-5003-4497-8fc8-82c911e65487 tempest-DeleteServersTestJSON-823268338 tempest-DeleteServersTestJSON-823268338-project] 10.222.0.30 "GET /compute/v2.1/servers/58790243-9fe3-49d2-b029-40825911ddde" status: 200 len: 1314 microversion: 2.1 time: 0.295318 Jun 16 18:29:38.024522 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 76/147] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:29:37 2022] GET /compute/v2.1/servers/58790243-9fe3-49d2-b029-40825911ddde => generated 1314 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:29:38.299107 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-e8ebf75f-8b9e-440c-85f2-4e5eccbb8559 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:29:38.299956 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-e8ebf75f-8b9e-440c-85f2-4e5eccbb8559 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] [instance: 651b5fe1-0df7-4bc6-b18e-7caea544a93f] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:29:38.306668 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-e8ebf75f-8b9e-440c-85f2-4e5eccbb8559 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:38.307569 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-e8ebf75f-8b9e-440c-85f2-4e5eccbb8559 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:38.308537 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-e8ebf75f-8b9e-440c-85f2-4e5eccbb8559 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:38.309063 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-e8ebf75f-8b9e-440c-85f2-4e5eccbb8559 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:38.743645 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-ac7cf23b-0886-4c21-8c07-f528e8aaf350 tempest-VolumesNegativeTest-992612787 tempest-VolumesNegativeTest-992612787-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:29:38.745879 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-ac7cf23b-0886-4c21-8c07-f528e8aaf350 tempest-VolumesNegativeTest-992612787 tempest-VolumesNegativeTest-992612787-project] [instance: b626d1e4-c5fd-47aa-be1f-4dbd8c2d50b5] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:29:38.753434 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-ac7cf23b-0886-4c21-8c07-f528e8aaf350 tempest-VolumesNegativeTest-992612787 tempest-VolumesNegativeTest-992612787-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:38.754097 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-ac7cf23b-0886-4c21-8c07-f528e8aaf350 tempest-VolumesNegativeTest-992612787 tempest-VolumesNegativeTest-992612787-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:38.755097 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-ac7cf23b-0886-4c21-8c07-f528e8aaf350 tempest-VolumesNegativeTest-992612787 tempest-VolumesNegativeTest-992612787-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:38.755948 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-ac7cf23b-0886-4c21-8c07-f528e8aaf350 tempest-VolumesNegativeTest-992612787 tempest-VolumesNegativeTest-992612787-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:38.928671 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-e8ebf75f-8b9e-440c-85f2-4e5eccbb8559 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:29:38.957580 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-e8ebf75f-8b9e-440c-85f2-4e5eccbb8559 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:29:38.961034 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-e8ebf75f-8b9e-440c-85f2-4e5eccbb8559 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:29:38.963075 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-e8ebf75f-8b9e-440c-85f2-4e5eccbb8559 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] 10.222.0.30 "GET /compute/v2.1/servers/651b5fe1-0df7-4bc6-b18e-7caea544a93f" status: 200 len: 1407 microversion: 2.20 time: 0.667793 Jun 16 18:29:38.969601 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 72/148] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Jun 16 18:29:38 2022] GET /compute/v2.1/servers/651b5fe1-0df7-4bc6-b18e-7caea544a93f => generated 1407 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 18:29:38.985465 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-5a717de2-a7d7-488c-905f-4ee0a4c7879d tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:29:38.987596 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-5a717de2-a7d7-488c-905f-4ee0a4c7879d tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] [instance: 05981bed-b625-4e9a-b860-6a7ce1288e8d] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:29:38.995654 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-5a717de2-a7d7-488c-905f-4ee0a4c7879d tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:38.996500 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-5a717de2-a7d7-488c-905f-4ee0a4c7879d tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:38.997555 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-5a717de2-a7d7-488c-905f-4ee0a4c7879d tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:38.998164 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-5a717de2-a7d7-488c-905f-4ee0a4c7879d tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:39.000260 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-ac7cf23b-0886-4c21-8c07-f528e8aaf350 tempest-VolumesNegativeTest-992612787 tempest-VolumesNegativeTest-992612787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '479bda47e66544e8bfa47dad8294c180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '478dbeee61b6401c9dbb31c216ce537b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:29:39.022907 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-ac7cf23b-0886-4c21-8c07-f528e8aaf350 tempest-VolumesNegativeTest-992612787 tempest-VolumesNegativeTest-992612787-project] 10.222.0.30 "GET /compute/v2.1/servers/b626d1e4-c5fd-47aa-be1f-4dbd8c2d50b5" status: 200 len: 1315 microversion: 2.1 time: 0.282647 Jun 16 18:29:39.027815 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 77/149] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:29:38 2022] GET /compute/v2.1/servers/b626d1e4-c5fd-47aa-be1f-4dbd8c2d50b5 => generated 1315 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:29:39.056242 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-f9163087-0883-4783-9da2-c6eee767cb4c tempest-DeleteServersTestJSON-823268338 tempest-DeleteServersTestJSON-823268338-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:29:39.057545 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-f9163087-0883-4783-9da2-c6eee767cb4c tempest-DeleteServersTestJSON-823268338 tempest-DeleteServersTestJSON-823268338-project] [instance: 58790243-9fe3-49d2-b029-40825911ddde] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:29:39.070984 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-f9163087-0883-4783-9da2-c6eee767cb4c tempest-DeleteServersTestJSON-823268338 tempest-DeleteServersTestJSON-823268338-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:39.070984 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-f9163087-0883-4783-9da2-c6eee767cb4c tempest-DeleteServersTestJSON-823268338 tempest-DeleteServersTestJSON-823268338-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:39.070984 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-f9163087-0883-4783-9da2-c6eee767cb4c tempest-DeleteServersTestJSON-823268338 tempest-DeleteServersTestJSON-823268338-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:39.070984 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-f9163087-0883-4783-9da2-c6eee767cb4c tempest-DeleteServersTestJSON-823268338 tempest-DeleteServersTestJSON-823268338-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:39.359876 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-5a717de2-a7d7-488c-905f-4ee0a4c7879d tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512f01cca14b447c8f6c9eebbd828eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70bbccf07e3404cb94ba59201061a6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:29:39.389504 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-5a717de2-a7d7-488c-905f-4ee0a4c7879d tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] 10.222.0.30 "GET /compute/v2.1/servers/05981bed-b625-4e9a-b860-6a7ce1288e8d" status: 200 len: 1322 microversion: 2.1 time: 0.415471 Jun 16 18:29:39.398845 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 73/150] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:29:38 2022] GET /compute/v2.1/servers/05981bed-b625-4e9a-b860-6a7ce1288e8d => generated 1322 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:29:39.443133 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-f9163087-0883-4783-9da2-c6eee767cb4c tempest-DeleteServersTestJSON-823268338 tempest-DeleteServersTestJSON-823268338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee9c06c774f478db33c16b784d6b914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa9111175cad44b2bbc611b7ae36a991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:29:39.466218 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-f9163087-0883-4783-9da2-c6eee767cb4c tempest-DeleteServersTestJSON-823268338 tempest-DeleteServersTestJSON-823268338-project] 10.222.0.30 "GET /compute/v2.1/servers/58790243-9fe3-49d2-b029-40825911ddde" status: 200 len: 1314 microversion: 2.1 time: 0.418401 Jun 16 18:29:39.484123 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 78/151] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:29:39 2022] GET /compute/v2.1/servers/58790243-9fe3-49d2-b029-40825911ddde => generated 1314 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:29:39.999203 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-b47a60ac-8a65-4569-a822-b868f6e38f17 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:29:40.000467 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-b47a60ac-8a65-4569-a822-b868f6e38f17 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] [instance: 651b5fe1-0df7-4bc6-b18e-7caea544a93f] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:29:40.025462 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-b47a60ac-8a65-4569-a822-b868f6e38f17 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:40.042838 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-b47a60ac-8a65-4569-a822-b868f6e38f17 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:40.055253 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-56102777-e111-4907-a6ba-90f43840ea7d tempest-VolumesNegativeTest-992612787 tempest-VolumesNegativeTest-992612787-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:29:40.056595 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-b47a60ac-8a65-4569-a822-b868f6e38f17 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:40.057571 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-b47a60ac-8a65-4569-a822-b868f6e38f17 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:40.059988 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-56102777-e111-4907-a6ba-90f43840ea7d tempest-VolumesNegativeTest-992612787 tempest-VolumesNegativeTest-992612787-project] [instance: b626d1e4-c5fd-47aa-be1f-4dbd8c2d50b5] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:29:40.093687 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-56102777-e111-4907-a6ba-90f43840ea7d tempest-VolumesNegativeTest-992612787 tempest-VolumesNegativeTest-992612787-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:40.094353 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-56102777-e111-4907-a6ba-90f43840ea7d tempest-VolumesNegativeTest-992612787 tempest-VolumesNegativeTest-992612787-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:40.095795 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-56102777-e111-4907-a6ba-90f43840ea7d tempest-VolumesNegativeTest-992612787 tempest-VolumesNegativeTest-992612787-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:40.096628 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-56102777-e111-4907-a6ba-90f43840ea7d tempest-VolumesNegativeTest-992612787 tempest-VolumesNegativeTest-992612787-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:40.388428 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-b47a60ac-8a65-4569-a822-b868f6e38f17 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:29:40.400334 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-b47a60ac-8a65-4569-a822-b868f6e38f17 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:29:40.403613 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-b47a60ac-8a65-4569-a822-b868f6e38f17 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:29:40.405395 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-b47a60ac-8a65-4569-a822-b868f6e38f17 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] 10.222.0.30 "GET /compute/v2.1/servers/651b5fe1-0df7-4bc6-b18e-7caea544a93f" status: 200 len: 1407 microversion: 2.20 time: 0.413959 Jun 16 18:29:40.406127 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 74/152] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Jun 16 18:29:39 2022] GET /compute/v2.1/servers/651b5fe1-0df7-4bc6-b18e-7caea544a93f => generated 1407 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:29:40.425249 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [req-f352c621-47fd-43e2-86f3-fc2af1db139f req-e76669b0-2e03-4aac-9dd8-52e7f46da9d8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "121f052a-2d96-444d-a817-38e348aaf0e5", "tag": "0075a21e-8596-4b59-b394-0d2e2c21aab0"}]} {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:29:40.486957 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [req-f352c621-47fd-43e2-86f3-fc2af1db139f req-e76669b0-2e03-4aac-9dd8-52e7f46da9d8 service nova] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:40.488172 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [req-f352c621-47fd-43e2-86f3-fc2af1db139f req-e76669b0-2e03-4aac-9dd8-52e7f46da9d8 service nova] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:40.529730 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.compute.server_external_events [req-f352c621-47fd-43e2-86f3-fc2af1db139f req-e76669b0-2e03-4aac-9dd8-52e7f46da9d8 service nova] Creating event network-changed:0075a21e-8596-4b59-b394-0d2e2c21aab0 for instance 121f052a-2d96-444d-a817-38e348aaf0e5 on hv-cinder-81322 Jun 16 18:29:40.541934 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [req-f352c621-47fd-43e2-86f3-fc2af1db139f req-e76669b0-2e03-4aac-9dd8-52e7f46da9d8 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.132804 Jun 16 18:29:40.543995 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 75/153] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Jun 16 18:29:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:29:40.565324 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-56102777-e111-4907-a6ba-90f43840ea7d tempest-VolumesNegativeTest-992612787 tempest-VolumesNegativeTest-992612787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '479bda47e66544e8bfa47dad8294c180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '478dbeee61b6401c9dbb31c216ce537b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:29:40.576292 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-56102777-e111-4907-a6ba-90f43840ea7d tempest-VolumesNegativeTest-992612787 tempest-VolumesNegativeTest-992612787-project] 10.222.0.30 "GET /compute/v2.1/servers/b626d1e4-c5fd-47aa-be1f-4dbd8c2d50b5" status: 200 len: 1315 microversion: 2.1 time: 0.530020 Jun 16 18:29:40.581027 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 79/154] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:29:40 2022] GET /compute/v2.1/servers/b626d1e4-c5fd-47aa-be1f-4dbd8c2d50b5 => generated 1315 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:29:40.581263 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-e972dd25-185c-4841-8561-af70ea6fd8db tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:29:40.595408 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-f1f83ce5-41af-41fe-b6f1-8c325c575d6c tempest-DeleteServersTestJSON-823268338 tempest-DeleteServersTestJSON-823268338-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:29:40.595898 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-e972dd25-185c-4841-8561-af70ea6fd8db tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] [instance: 05981bed-b625-4e9a-b860-6a7ce1288e8d] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:29:40.596991 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-f1f83ce5-41af-41fe-b6f1-8c325c575d6c tempest-DeleteServersTestJSON-823268338 tempest-DeleteServersTestJSON-823268338-project] [instance: 58790243-9fe3-49d2-b029-40825911ddde] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:29:40.609977 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-f1f83ce5-41af-41fe-b6f1-8c325c575d6c tempest-DeleteServersTestJSON-823268338 tempest-DeleteServersTestJSON-823268338-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:40.611092 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-f1f83ce5-41af-41fe-b6f1-8c325c575d6c tempest-DeleteServersTestJSON-823268338 tempest-DeleteServersTestJSON-823268338-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:40.612100 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-f1f83ce5-41af-41fe-b6f1-8c325c575d6c tempest-DeleteServersTestJSON-823268338 tempest-DeleteServersTestJSON-823268338-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:40.612697 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-f1f83ce5-41af-41fe-b6f1-8c325c575d6c tempest-DeleteServersTestJSON-823268338 tempest-DeleteServersTestJSON-823268338-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:40.634154 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-e972dd25-185c-4841-8561-af70ea6fd8db tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:40.637302 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-e972dd25-185c-4841-8561-af70ea6fd8db tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:40.638892 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-e972dd25-185c-4841-8561-af70ea6fd8db tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:40.642962 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-e972dd25-185c-4841-8561-af70ea6fd8db tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:40.902344 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-f1f83ce5-41af-41fe-b6f1-8c325c575d6c tempest-DeleteServersTestJSON-823268338 tempest-DeleteServersTestJSON-823268338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee9c06c774f478db33c16b784d6b914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa9111175cad44b2bbc611b7ae36a991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:29:40.921707 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-f1f83ce5-41af-41fe-b6f1-8c325c575d6c tempest-DeleteServersTestJSON-823268338 tempest-DeleteServersTestJSON-823268338-project] 10.222.0.30 "GET /compute/v2.1/servers/58790243-9fe3-49d2-b029-40825911ddde" status: 200 len: 1501 microversion: 2.1 time: 0.338227 Jun 16 18:29:40.924132 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 80/155] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:29:40 2022] GET /compute/v2.1/servers/58790243-9fe3-49d2-b029-40825911ddde => generated 1501 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:29:40.939726 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-e972dd25-185c-4841-8561-af70ea6fd8db tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512f01cca14b447c8f6c9eebbd828eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70bbccf07e3404cb94ba59201061a6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:29:40.953620 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-e972dd25-185c-4841-8561-af70ea6fd8db tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] 10.222.0.30 "GET /compute/v2.1/servers/05981bed-b625-4e9a-b860-6a7ce1288e8d" status: 200 len: 1322 microversion: 2.1 time: 0.407238 Jun 16 18:29:40.954214 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 76/156] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:29:40 2022] GET /compute/v2.1/servers/05981bed-b625-4e9a-b860-6a7ce1288e8d => generated 1322 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:29:41.433069 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-6ef437ca-4cc2-4ed0-8957-0e43f9d80199 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:29:41.437783 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-6ef437ca-4cc2-4ed0-8957-0e43f9d80199 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] [instance: 651b5fe1-0df7-4bc6-b18e-7caea544a93f] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:29:41.467921 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-6ef437ca-4cc2-4ed0-8957-0e43f9d80199 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:41.471425 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-6ef437ca-4cc2-4ed0-8957-0e43f9d80199 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:41.474626 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-6ef437ca-4cc2-4ed0-8957-0e43f9d80199 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:41.475531 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-6ef437ca-4cc2-4ed0-8957-0e43f9d80199 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:41.599103 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-ee80a162-a03b-445d-99af-25494a0f5873 tempest-VolumesNegativeTest-992612787 tempest-VolumesNegativeTest-992612787-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:29:41.600585 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-ee80a162-a03b-445d-99af-25494a0f5873 tempest-VolumesNegativeTest-992612787 tempest-VolumesNegativeTest-992612787-project] [instance: b626d1e4-c5fd-47aa-be1f-4dbd8c2d50b5] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:29:41.610045 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-ee80a162-a03b-445d-99af-25494a0f5873 tempest-VolumesNegativeTest-992612787 tempest-VolumesNegativeTest-992612787-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:41.621040 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-ee80a162-a03b-445d-99af-25494a0f5873 tempest-VolumesNegativeTest-992612787 tempest-VolumesNegativeTest-992612787-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:41.622549 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-ee80a162-a03b-445d-99af-25494a0f5873 tempest-VolumesNegativeTest-992612787 tempest-VolumesNegativeTest-992612787-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:41.625283 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-ee80a162-a03b-445d-99af-25494a0f5873 tempest-VolumesNegativeTest-992612787 tempest-VolumesNegativeTest-992612787-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:42.037507 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-6ef437ca-4cc2-4ed0-8957-0e43f9d80199 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:29:42.059660 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-6ef437ca-4cc2-4ed0-8957-0e43f9d80199 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:29:42.061324 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-6ef437ca-4cc2-4ed0-8957-0e43f9d80199 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:29:42.091342 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-6ef437ca-4cc2-4ed0-8957-0e43f9d80199 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] 10.222.0.30 "GET /compute/v2.1/servers/651b5fe1-0df7-4bc6-b18e-7caea544a93f" status: 200 len: 1407 microversion: 2.20 time: 0.655592 Jun 16 18:29:42.091342 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 81/157] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Jun 16 18:29:41 2022] GET /compute/v2.1/servers/651b5fe1-0df7-4bc6-b18e-7caea544a93f => generated 1407 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:29:42.099573 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [req-e2a6e08b-f086-4eac-a7a1-af68e0a24f68 req-fd36d1aa-30f3-4f52-8150-a690f047eb52 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "651b5fe1-0df7-4bc6-b18e-7caea544a93f", "name": "network-vif-plugged", "status": "completed", "tag": "7416c7c3-1e79-4777-a950-c0c27847ca8e"}]} {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:29:42.130946 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [req-e2a6e08b-f086-4eac-a7a1-af68e0a24f68 req-fd36d1aa-30f3-4f52-8150-a690f047eb52 service nova] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:42.135631 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [req-e2a6e08b-f086-4eac-a7a1-af68e0a24f68 req-fd36d1aa-30f3-4f52-8150-a690f047eb52 service nova] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:42.167162 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.compute.server_external_events [req-e2a6e08b-f086-4eac-a7a1-af68e0a24f68 req-fd36d1aa-30f3-4f52-8150-a690f047eb52 service nova] Creating event network-vif-plugged:7416c7c3-1e79-4777-a950-c0c27847ca8e for instance 651b5fe1-0df7-4bc6-b18e-7caea544a93f on hv-cinder-81322 Jun 16 18:29:42.193710 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [req-e2a6e08b-f086-4eac-a7a1-af68e0a24f68 req-fd36d1aa-30f3-4f52-8150-a690f047eb52 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111626 Jun 16 18:29:42.199214 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 82/158] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Jun 16 18:29:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:29:42.217672 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-01bf7c71-8678-461e-a1a1-9e86b216299d tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:29:42.222096 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-01bf7c71-8678-461e-a1a1-9e86b216299d tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] [instance: 05981bed-b625-4e9a-b860-6a7ce1288e8d] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:29:42.229347 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-ee80a162-a03b-445d-99af-25494a0f5873 tempest-VolumesNegativeTest-992612787 tempest-VolumesNegativeTest-992612787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '479bda47e66544e8bfa47dad8294c180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '478dbeee61b6401c9dbb31c216ce537b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:29:42.239342 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-01bf7c71-8678-461e-a1a1-9e86b216299d tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:42.244145 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-01bf7c71-8678-461e-a1a1-9e86b216299d tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:42.249148 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-01bf7c71-8678-461e-a1a1-9e86b216299d tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:42.250492 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-01bf7c71-8678-461e-a1a1-9e86b216299d tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:42.262190 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-ee80a162-a03b-445d-99af-25494a0f5873 tempest-VolumesNegativeTest-992612787 tempest-VolumesNegativeTest-992612787-project] 10.222.0.30 "GET /compute/v2.1/servers/b626d1e4-c5fd-47aa-be1f-4dbd8c2d50b5" status: 200 len: 1315 microversion: 2.1 time: 0.666367 Jun 16 18:29:42.280354 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 77/159] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:29:41 2022] GET /compute/v2.1/servers/b626d1e4-c5fd-47aa-be1f-4dbd8c2d50b5 => generated 1315 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:29:42.563050 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-01bf7c71-8678-461e-a1a1-9e86b216299d tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512f01cca14b447c8f6c9eebbd828eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70bbccf07e3404cb94ba59201061a6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:29:42.579480 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-01bf7c71-8678-461e-a1a1-9e86b216299d tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] 10.222.0.30 "GET /compute/v2.1/servers/05981bed-b625-4e9a-b860-6a7ce1288e8d" status: 200 len: 1322 microversion: 2.1 time: 0.374289 Jun 16 18:29:42.581350 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 83/160] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:29:42 2022] GET /compute/v2.1/servers/05981bed-b625-4e9a-b860-6a7ce1288e8d => generated 1322 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:29:42.872255 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-2a0812fc-c0a8-4108-971d-fea4241bb832 tempest-DeleteServersTestJSON-823268338 tempest-DeleteServersTestJSON-823268338-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "88990777-792b-4a43-b61e-827c264501c2"}} {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:29:42.875024 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-2a0812fc-c0a8-4108-971d-fea4241bb832 tempest-DeleteServersTestJSON-823268338 tempest-DeleteServersTestJSON-823268338-project] [instance: 58790243-9fe3-49d2-b029-40825911ddde] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:29:42.891448 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-2a0812fc-c0a8-4108-971d-fea4241bb832 tempest-DeleteServersTestJSON-823268338 tempest-DeleteServersTestJSON-823268338-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:42.892472 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-2a0812fc-c0a8-4108-971d-fea4241bb832 tempest-DeleteServersTestJSON-823268338 tempest-DeleteServersTestJSON-823268338-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:42.894725 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-2a0812fc-c0a8-4108-971d-fea4241bb832 tempest-DeleteServersTestJSON-823268338 tempest-DeleteServersTestJSON-823268338-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:42.896292 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-2a0812fc-c0a8-4108-971d-fea4241bb832 tempest-DeleteServersTestJSON-823268338 tempest-DeleteServersTestJSON-823268338-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:43.117210 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-2e6fa2f1-d6b7-49c3-9888-22b39b1bdfcc tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:29:43.119927 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-2e6fa2f1-d6b7-49c3-9888-22b39b1bdfcc tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] [instance: 651b5fe1-0df7-4bc6-b18e-7caea544a93f] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:29:43.128754 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-2e6fa2f1-d6b7-49c3-9888-22b39b1bdfcc tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:43.129503 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-2e6fa2f1-d6b7-49c3-9888-22b39b1bdfcc tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:43.130997 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-2e6fa2f1-d6b7-49c3-9888-22b39b1bdfcc tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:43.131639 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-2e6fa2f1-d6b7-49c3-9888-22b39b1bdfcc tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:43.388671 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-2e6fa2f1-d6b7-49c3-9888-22b39b1bdfcc tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:29:43.399579 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-2e6fa2f1-d6b7-49c3-9888-22b39b1bdfcc tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:29:43.403085 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-2e6fa2f1-d6b7-49c3-9888-22b39b1bdfcc tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:29:43.404998 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-2e6fa2f1-d6b7-49c3-9888-22b39b1bdfcc tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] 10.222.0.30 "GET /compute/v2.1/servers/651b5fe1-0df7-4bc6-b18e-7caea544a93f" status: 200 len: 1407 microversion: 2.20 time: 0.296951 Jun 16 18:29:43.406192 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 84/161] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Jun 16 18:29:43 2022] GET /compute/v2.1/servers/651b5fe1-0df7-4bc6-b18e-7caea544a93f => generated 1407 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 18:29:43.412124 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-e8e983db-aa06-485b-8767-3e202abc38ef tempest-VolumesNegativeTest-992612787 tempest-VolumesNegativeTest-992612787-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:29:43.413257 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-e8e983db-aa06-485b-8767-3e202abc38ef tempest-VolumesNegativeTest-992612787 tempest-VolumesNegativeTest-992612787-project] [instance: b626d1e4-c5fd-47aa-be1f-4dbd8c2d50b5] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:29:43.422014 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-e8e983db-aa06-485b-8767-3e202abc38ef tempest-VolumesNegativeTest-992612787 tempest-VolumesNegativeTest-992612787-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:43.422868 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-e8e983db-aa06-485b-8767-3e202abc38ef tempest-VolumesNegativeTest-992612787 tempest-VolumesNegativeTest-992612787-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:43.423912 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-e8e983db-aa06-485b-8767-3e202abc38ef tempest-VolumesNegativeTest-992612787 tempest-VolumesNegativeTest-992612787-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:43.424983 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-e8e983db-aa06-485b-8767-3e202abc38ef tempest-VolumesNegativeTest-992612787 tempest-VolumesNegativeTest-992612787-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:43.711796 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-e8e983db-aa06-485b-8767-3e202abc38ef tempest-VolumesNegativeTest-992612787 tempest-VolumesNegativeTest-992612787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '479bda47e66544e8bfa47dad8294c180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '478dbeee61b6401c9dbb31c216ce537b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:29:43.733211 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-e8e983db-aa06-485b-8767-3e202abc38ef tempest-VolumesNegativeTest-992612787 tempest-VolumesNegativeTest-992612787-project] 10.222.0.30 "GET /compute/v2.1/servers/b626d1e4-c5fd-47aa-be1f-4dbd8c2d50b5" status: 200 len: 1315 microversion: 2.1 time: 0.322073 Jun 16 18:29:43.734600 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 85/162] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:29:43 2022] GET /compute/v2.1/servers/b626d1e4-c5fd-47aa-be1f-4dbd8c2d50b5 => generated 1315 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:29:43.743599 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-e72d1647-0443-4e16-8ef3-49ed754a5835 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:29:43.745440 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-e72d1647-0443-4e16-8ef3-49ed754a5835 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] [instance: 05981bed-b625-4e9a-b860-6a7ce1288e8d] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:29:43.756012 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-e72d1647-0443-4e16-8ef3-49ed754a5835 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:43.757059 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-e72d1647-0443-4e16-8ef3-49ed754a5835 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:43.758493 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-e72d1647-0443-4e16-8ef3-49ed754a5835 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:43.759297 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-e72d1647-0443-4e16-8ef3-49ed754a5835 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:44.003543 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-e72d1647-0443-4e16-8ef3-49ed754a5835 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512f01cca14b447c8f6c9eebbd828eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70bbccf07e3404cb94ba59201061a6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:29:44.013331 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-e72d1647-0443-4e16-8ef3-49ed754a5835 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] 10.222.0.30 "GET /compute/v2.1/servers/05981bed-b625-4e9a-b860-6a7ce1288e8d" status: 200 len: 1322 microversion: 2.1 time: 0.277205 Jun 16 18:29:44.013933 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 86/163] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:29:43 2022] GET /compute/v2.1/servers/05981bed-b625-4e9a-b860-6a7ce1288e8d => generated 1322 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:29:44.254874 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [req-c58f25ae-8de9-4f7a-96a0-f378fd59edf3 req-2209d207-ffad-4cda-bf7f-65a65245b8d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b626d1e4-c5fd-47aa-be1f-4dbd8c2d50b5", "name": "network-vif-plugged", "status": "completed", "tag": "e304be79-1d40-45f4-99ca-97459a28a681"}]} {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:29:44.266639 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [req-c58f25ae-8de9-4f7a-96a0-f378fd59edf3 req-2209d207-ffad-4cda-bf7f-65a65245b8d7 service nova] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:44.267088 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [req-c58f25ae-8de9-4f7a-96a0-f378fd59edf3 req-2209d207-ffad-4cda-bf7f-65a65245b8d7 service nova] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:44.280546 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.compute.server_external_events [req-c58f25ae-8de9-4f7a-96a0-f378fd59edf3 req-2209d207-ffad-4cda-bf7f-65a65245b8d7 service nova] Creating event network-vif-plugged:e304be79-1d40-45f4-99ca-97459a28a681 for instance b626d1e4-c5fd-47aa-be1f-4dbd8c2d50b5 on hv-cinder-81322 Jun 16 18:29:44.297233 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [req-c58f25ae-8de9-4f7a-96a0-f378fd59edf3 req-2209d207-ffad-4cda-bf7f-65a65245b8d7 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046932 Jun 16 18:29:44.297849 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 87/164] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Jun 16 18:29:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 18:29:44.437314 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-84aacfea-3d0f-429c-bec7-f9144512a239 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:29:44.438269 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-84aacfea-3d0f-429c-bec7-f9144512a239 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] [instance: 651b5fe1-0df7-4bc6-b18e-7caea544a93f] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:29:44.444993 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-84aacfea-3d0f-429c-bec7-f9144512a239 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:44.445579 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-84aacfea-3d0f-429c-bec7-f9144512a239 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:44.446379 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-84aacfea-3d0f-429c-bec7-f9144512a239 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:44.446948 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-84aacfea-3d0f-429c-bec7-f9144512a239 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:44.472432 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG dbcounter [-] [117670] Writing DB stats nova_cell1:SELECT=100 {{(pid=117670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:29:44.618637 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-84aacfea-3d0f-429c-bec7-f9144512a239 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:29:44.635704 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-84aacfea-3d0f-429c-bec7-f9144512a239 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:29:44.639985 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-84aacfea-3d0f-429c-bec7-f9144512a239 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:29:44.642410 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-84aacfea-3d0f-429c-bec7-f9144512a239 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] 10.222.0.30 "GET /compute/v2.1/servers/651b5fe1-0df7-4bc6-b18e-7caea544a93f" status: 200 len: 1407 microversion: 2.20 time: 0.210835 Jun 16 18:29:44.643573 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 88/165] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Jun 16 18:29:44 2022] GET /compute/v2.1/servers/651b5fe1-0df7-4bc6-b18e-7caea544a93f => generated 1407 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 18:29:44.752821 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-e2e51731-5d6f-4d84-a1cd-818b0d4854de tempest-VolumesNegativeTest-992612787 tempest-VolumesNegativeTest-992612787-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:29:44.754073 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-e2e51731-5d6f-4d84-a1cd-818b0d4854de tempest-VolumesNegativeTest-992612787 tempest-VolumesNegativeTest-992612787-project] [instance: b626d1e4-c5fd-47aa-be1f-4dbd8c2d50b5] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:29:44.763331 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-e2e51731-5d6f-4d84-a1cd-818b0d4854de tempest-VolumesNegativeTest-992612787 tempest-VolumesNegativeTest-992612787-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:44.764227 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-e2e51731-5d6f-4d84-a1cd-818b0d4854de tempest-VolumesNegativeTest-992612787 tempest-VolumesNegativeTest-992612787-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:44.765061 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-e2e51731-5d6f-4d84-a1cd-818b0d4854de tempest-VolumesNegativeTest-992612787 tempest-VolumesNegativeTest-992612787-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:44.765534 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-e2e51731-5d6f-4d84-a1cd-818b0d4854de tempest-VolumesNegativeTest-992612787 tempest-VolumesNegativeTest-992612787-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:44.973811 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-e2e51731-5d6f-4d84-a1cd-818b0d4854de tempest-VolumesNegativeTest-992612787 tempest-VolumesNegativeTest-992612787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '479bda47e66544e8bfa47dad8294c180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '478dbeee61b6401c9dbb31c216ce537b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:29:44.988091 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-e2e51731-5d6f-4d84-a1cd-818b0d4854de tempest-VolumesNegativeTest-992612787 tempest-VolumesNegativeTest-992612787-project] 10.222.0.30 "GET /compute/v2.1/servers/b626d1e4-c5fd-47aa-be1f-4dbd8c2d50b5" status: 200 len: 1315 microversion: 2.1 time: 0.239747 Jun 16 18:29:44.990202 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 89/166] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:29:44 2022] GET /compute/v2.1/servers/b626d1e4-c5fd-47aa-be1f-4dbd8c2d50b5 => generated 1315 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:29:45.047309 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-f39de2b9-4aa9-464f-9486-84e863345f13 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:29:45.048648 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-f39de2b9-4aa9-464f-9486-84e863345f13 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] [instance: 05981bed-b625-4e9a-b860-6a7ce1288e8d] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:29:45.064675 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-f39de2b9-4aa9-464f-9486-84e863345f13 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:45.065852 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-f39de2b9-4aa9-464f-9486-84e863345f13 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:45.071616 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-f39de2b9-4aa9-464f-9486-84e863345f13 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:45.073411 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-f39de2b9-4aa9-464f-9486-84e863345f13 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:45.329551 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-f39de2b9-4aa9-464f-9486-84e863345f13 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512f01cca14b447c8f6c9eebbd828eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70bbccf07e3404cb94ba59201061a6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:29:45.340460 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-f39de2b9-4aa9-464f-9486-84e863345f13 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] 10.222.0.30 "GET /compute/v2.1/servers/05981bed-b625-4e9a-b860-6a7ce1288e8d" status: 200 len: 1322 microversion: 2.1 time: 0.300727 Jun 16 18:29:45.341149 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 90/167] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:29:45 2022] GET /compute/v2.1/servers/05981bed-b625-4e9a-b860-6a7ce1288e8d => generated 1322 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:29:45.665501 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-545de1f7-dc98-43dd-bc58-40320b962cef tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:29:45.666966 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-545de1f7-dc98-43dd-bc58-40320b962cef tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] [instance: 651b5fe1-0df7-4bc6-b18e-7caea544a93f] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:29:45.678398 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-545de1f7-dc98-43dd-bc58-40320b962cef tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:45.679638 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-545de1f7-dc98-43dd-bc58-40320b962cef tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:45.681974 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-545de1f7-dc98-43dd-bc58-40320b962cef tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:45.683011 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-545de1f7-dc98-43dd-bc58-40320b962cef tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:46.020628 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-545de1f7-dc98-43dd-bc58-40320b962cef tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:29:46.046315 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-545de1f7-dc98-43dd-bc58-40320b962cef tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:29:46.051679 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-545de1f7-dc98-43dd-bc58-40320b962cef tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:29:46.058839 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-545de1f7-dc98-43dd-bc58-40320b962cef tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] 10.222.0.30 "GET /compute/v2.1/servers/651b5fe1-0df7-4bc6-b18e-7caea544a93f" status: 200 len: 1407 microversion: 2.20 time: 0.399557 Jun 16 18:29:46.062127 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 91/168] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Jun 16 18:29:45 2022] GET /compute/v2.1/servers/651b5fe1-0df7-4bc6-b18e-7caea544a93f => generated 1407 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:29:46.081553 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-cd5f1fd6-89ec-49f7-82c1-6a46cceeb52a tempest-VolumesNegativeTest-992612787 tempest-VolumesNegativeTest-992612787-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:29:46.084293 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-cd5f1fd6-89ec-49f7-82c1-6a46cceeb52a tempest-VolumesNegativeTest-992612787 tempest-VolumesNegativeTest-992612787-project] [instance: b626d1e4-c5fd-47aa-be1f-4dbd8c2d50b5] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:29:46.099490 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-cd5f1fd6-89ec-49f7-82c1-6a46cceeb52a tempest-VolumesNegativeTest-992612787 tempest-VolumesNegativeTest-992612787-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:46.100835 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-cd5f1fd6-89ec-49f7-82c1-6a46cceeb52a tempest-VolumesNegativeTest-992612787 tempest-VolumesNegativeTest-992612787-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:46.104356 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-cd5f1fd6-89ec-49f7-82c1-6a46cceeb52a tempest-VolumesNegativeTest-992612787 tempest-VolumesNegativeTest-992612787-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:46.105800 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-cd5f1fd6-89ec-49f7-82c1-6a46cceeb52a tempest-VolumesNegativeTest-992612787 tempest-VolumesNegativeTest-992612787-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:46.500316 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-2a0812fc-c0a8-4108-971d-fea4241bb832 tempest-DeleteServersTestJSON-823268338 tempest-DeleteServersTestJSON-823268338-project] 10.222.0.30 "POST /compute/v2.1/servers/58790243-9fe3-49d2-b029-40825911ddde/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.635615 Jun 16 18:29:46.502984 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 78/169] 10.222.0.30 () {60 vars in 1322 bytes} [Thu Jun 16 18:29:42 2022] POST /compute/v2.1/servers/58790243-9fe3-49d2-b029-40825911ddde/os-volume_attachments => generated 194 bytes in 3641 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:29:46.524403 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-c1b716d4-2be9-4ee4-95f7-c9a542598b6f tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:29:46.526318 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-c1b716d4-2be9-4ee4-95f7-c9a542598b6f tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] [instance: 05981bed-b625-4e9a-b860-6a7ce1288e8d] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:29:46.547003 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-c1b716d4-2be9-4ee4-95f7-c9a542598b6f tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:46.549731 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-c1b716d4-2be9-4ee4-95f7-c9a542598b6f tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:46.552382 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-c1b716d4-2be9-4ee4-95f7-c9a542598b6f tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:46.553488 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-c1b716d4-2be9-4ee4-95f7-c9a542598b6f tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:46.765188 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-cd5f1fd6-89ec-49f7-82c1-6a46cceeb52a tempest-VolumesNegativeTest-992612787 tempest-VolumesNegativeTest-992612787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '479bda47e66544e8bfa47dad8294c180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '478dbeee61b6401c9dbb31c216ce537b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:29:46.784404 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-cd5f1fd6-89ec-49f7-82c1-6a46cceeb52a tempest-VolumesNegativeTest-992612787 tempest-VolumesNegativeTest-992612787-project] 10.222.0.30 "GET /compute/v2.1/servers/b626d1e4-c5fd-47aa-be1f-4dbd8c2d50b5" status: 200 len: 1315 microversion: 2.1 time: 0.718408 Jun 16 18:29:46.785839 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 92/170] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:29:46 2022] GET /compute/v2.1/servers/b626d1e4-c5fd-47aa-be1f-4dbd8c2d50b5 => generated 1315 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:29:46.925446 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-c1b716d4-2be9-4ee4-95f7-c9a542598b6f tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512f01cca14b447c8f6c9eebbd828eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70bbccf07e3404cb94ba59201061a6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:29:46.936195 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-c1b716d4-2be9-4ee4-95f7-c9a542598b6f tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] 10.222.0.30 "GET /compute/v2.1/servers/05981bed-b625-4e9a-b860-6a7ce1288e8d" status: 200 len: 1516 microversion: 2.1 time: 0.431011 Jun 16 18:29:46.936999 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 79/171] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:29:46 2022] GET /compute/v2.1/servers/05981bed-b625-4e9a-b860-6a7ce1288e8d => generated 1516 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:29:46.958160 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-40810d3f-a0fe-42dc-bc4c-ecb46038c1a6 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:29:46.961422 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-40810d3f-a0fe-42dc-bc4c-ecb46038c1a6 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] [instance: 05981bed-b625-4e9a-b860-6a7ce1288e8d] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:29:46.973529 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-40810d3f-a0fe-42dc-bc4c-ecb46038c1a6 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:46.975007 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-40810d3f-a0fe-42dc-bc4c-ecb46038c1a6 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:46.975784 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-40810d3f-a0fe-42dc-bc4c-ecb46038c1a6 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:46.976598 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-40810d3f-a0fe-42dc-bc4c-ecb46038c1a6 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:47.021387 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.objects.instance [None req-40810d3f-a0fe-42dc-bc4c-ecb46038c1a6 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lazy-loading 'flavor' on Instance uuid 05981bed-b625-4e9a-b860-6a7ce1288e8d {{(pid=117670) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 18:29:47.086194 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-8c9b997d-1507-437c-9645-7727c7f6c790 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:29:47.087807 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-8c9b997d-1507-437c-9645-7727c7f6c790 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] [instance: 651b5fe1-0df7-4bc6-b18e-7caea544a93f] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:29:47.100845 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-8c9b997d-1507-437c-9645-7727c7f6c790 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:47.101806 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-8c9b997d-1507-437c-9645-7727c7f6c790 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:47.103205 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-8c9b997d-1507-437c-9645-7727c7f6c790 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:47.104733 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-8c9b997d-1507-437c-9645-7727c7f6c790 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:47.177101 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-40810d3f-a0fe-42dc-bc4c-ecb46038c1a6 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] 10.222.0.30 "POST /compute/v2.1/servers/05981bed-b625-4e9a-b860-6a7ce1288e8d/action" status: 200 len: 32 microversion: 2.1 time: 0.224050 Jun 16 18:29:47.178928 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 93/172] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Jun 16 18:29:46 2022] POST /compute/v2.1/servers/05981bed-b625-4e9a-b860-6a7ce1288e8d/action => generated 32 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 16 18:29:47.193987 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-2910eab1-f364-4e99-b870-03d093373c48 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:29:47.195375 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-2910eab1-f364-4e99-b870-03d093373c48 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] [instance: 05981bed-b625-4e9a-b860-6a7ce1288e8d] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:29:47.204472 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-2910eab1-f364-4e99-b870-03d093373c48 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:47.205543 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-2910eab1-f364-4e99-b870-03d093373c48 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:47.206619 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-2910eab1-f364-4e99-b870-03d093373c48 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:47.207266 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-2910eab1-f364-4e99-b870-03d093373c48 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:47.388001 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-8c9b997d-1507-437c-9645-7727c7f6c790 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:29:47.405872 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-8c9b997d-1507-437c-9645-7727c7f6c790 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:29:47.408593 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-8c9b997d-1507-437c-9645-7727c7f6c790 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:29:47.410712 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-8c9b997d-1507-437c-9645-7727c7f6c790 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] 10.222.0.30 "GET /compute/v2.1/servers/651b5fe1-0df7-4bc6-b18e-7caea544a93f" status: 200 len: 1407 microversion: 2.20 time: 0.331501 Jun 16 18:29:47.412181 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 80/173] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Jun 16 18:29:47 2022] GET /compute/v2.1/servers/651b5fe1-0df7-4bc6-b18e-7caea544a93f => generated 1407 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:29:47.442243 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-2910eab1-f364-4e99-b870-03d093373c48 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512f01cca14b447c8f6c9eebbd828eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70bbccf07e3404cb94ba59201061a6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:29:47.452591 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-2910eab1-f364-4e99-b870-03d093373c48 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] 10.222.0.30 "GET /compute/v2.1/servers/05981bed-b625-4e9a-b860-6a7ce1288e8d" status: 200 len: 1522 microversion: 2.1 time: 0.263838 Jun 16 18:29:47.453191 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 94/174] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:29:47 2022] GET /compute/v2.1/servers/05981bed-b625-4e9a-b860-6a7ce1288e8d => generated 1522 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:29:47.810742 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-9f4eb10f-879f-44b5-94e8-f5eefb68adc5 tempest-VolumesNegativeTest-992612787 tempest-VolumesNegativeTest-992612787-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:29:47.811587 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-9f4eb10f-879f-44b5-94e8-f5eefb68adc5 tempest-VolumesNegativeTest-992612787 tempest-VolumesNegativeTest-992612787-project] [instance: b626d1e4-c5fd-47aa-be1f-4dbd8c2d50b5] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:29:47.818161 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-9f4eb10f-879f-44b5-94e8-f5eefb68adc5 tempest-VolumesNegativeTest-992612787 tempest-VolumesNegativeTest-992612787-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:47.818788 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-9f4eb10f-879f-44b5-94e8-f5eefb68adc5 tempest-VolumesNegativeTest-992612787 tempest-VolumesNegativeTest-992612787-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:47.819678 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-9f4eb10f-879f-44b5-94e8-f5eefb68adc5 tempest-VolumesNegativeTest-992612787 tempest-VolumesNegativeTest-992612787-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:47.820227 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-9f4eb10f-879f-44b5-94e8-f5eefb68adc5 tempest-VolumesNegativeTest-992612787 tempest-VolumesNegativeTest-992612787-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:47.998133 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-9f4eb10f-879f-44b5-94e8-f5eefb68adc5 tempest-VolumesNegativeTest-992612787 tempest-VolumesNegativeTest-992612787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '479bda47e66544e8bfa47dad8294c180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '478dbeee61b6401c9dbb31c216ce537b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:29:48.015984 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-9f4eb10f-879f-44b5-94e8-f5eefb68adc5 tempest-VolumesNegativeTest-992612787 tempest-VolumesNegativeTest-992612787-project] 10.222.0.30 "GET /compute/v2.1/servers/b626d1e4-c5fd-47aa-be1f-4dbd8c2d50b5" status: 200 len: 1315 microversion: 2.1 time: 0.207229 Jun 16 18:29:48.015984 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 81/175] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:29:47 2022] GET /compute/v2.1/servers/b626d1e4-c5fd-47aa-be1f-4dbd8c2d50b5 => generated 1315 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:29:48.435672 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-bc67ef29-6e0c-410c-b67f-c09d3e416372 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:29:48.436808 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-bc67ef29-6e0c-410c-b67f-c09d3e416372 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] [instance: 651b5fe1-0df7-4bc6-b18e-7caea544a93f] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:29:48.449076 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-bc67ef29-6e0c-410c-b67f-c09d3e416372 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:48.449967 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-bc67ef29-6e0c-410c-b67f-c09d3e416372 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:48.451715 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-bc67ef29-6e0c-410c-b67f-c09d3e416372 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:48.452493 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-bc67ef29-6e0c-410c-b67f-c09d3e416372 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:48.483081 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-959e6fb5-b818-4d74-826f-ee211956b615 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:29:48.483766 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-959e6fb5-b818-4d74-826f-ee211956b615 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] [instance: 05981bed-b625-4e9a-b860-6a7ce1288e8d] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:29:48.492079 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-959e6fb5-b818-4d74-826f-ee211956b615 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:48.492876 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-959e6fb5-b818-4d74-826f-ee211956b615 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:48.495170 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-959e6fb5-b818-4d74-826f-ee211956b615 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:48.496001 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-959e6fb5-b818-4d74-826f-ee211956b615 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:48.711331 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-bc67ef29-6e0c-410c-b67f-c09d3e416372 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:29:48.724287 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-bc67ef29-6e0c-410c-b67f-c09d3e416372 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:29:48.725890 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-bc67ef29-6e0c-410c-b67f-c09d3e416372 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:29:48.727045 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-bc67ef29-6e0c-410c-b67f-c09d3e416372 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] 10.222.0.30 "GET /compute/v2.1/servers/651b5fe1-0df7-4bc6-b18e-7caea544a93f" status: 200 len: 1407 microversion: 2.20 time: 0.299231 Jun 16 18:29:48.736139 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 95/176] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Jun 16 18:29:48 2022] GET /compute/v2.1/servers/651b5fe1-0df7-4bc6-b18e-7caea544a93f => generated 1407 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:29:48.842488 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-959e6fb5-b818-4d74-826f-ee211956b615 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512f01cca14b447c8f6c9eebbd828eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70bbccf07e3404cb94ba59201061a6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:29:48.859489 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-959e6fb5-b818-4d74-826f-ee211956b615 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] 10.222.0.30 "GET /compute/v2.1/servers/05981bed-b625-4e9a-b860-6a7ce1288e8d" status: 200 len: 1522 microversion: 2.1 time: 0.381165 Jun 16 18:29:48.860567 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 82/177] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:29:48 2022] GET /compute/v2.1/servers/05981bed-b625-4e9a-b860-6a7ce1288e8d => generated 1522 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:29:49.038771 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-4a681afc-9e1b-44c1-b7ee-84437ccd5f78 tempest-VolumesNegativeTest-992612787 tempest-VolumesNegativeTest-992612787-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:29:49.039567 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-4a681afc-9e1b-44c1-b7ee-84437ccd5f78 tempest-VolumesNegativeTest-992612787 tempest-VolumesNegativeTest-992612787-project] [instance: b626d1e4-c5fd-47aa-be1f-4dbd8c2d50b5] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:29:49.052559 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-4a681afc-9e1b-44c1-b7ee-84437ccd5f78 tempest-VolumesNegativeTest-992612787 tempest-VolumesNegativeTest-992612787-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:49.053402 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-4a681afc-9e1b-44c1-b7ee-84437ccd5f78 tempest-VolumesNegativeTest-992612787 tempest-VolumesNegativeTest-992612787-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:49.054781 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-4a681afc-9e1b-44c1-b7ee-84437ccd5f78 tempest-VolumesNegativeTest-992612787 tempest-VolumesNegativeTest-992612787-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:49.055425 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-4a681afc-9e1b-44c1-b7ee-84437ccd5f78 tempest-VolumesNegativeTest-992612787 tempest-VolumesNegativeTest-992612787-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:49.315786 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-4a681afc-9e1b-44c1-b7ee-84437ccd5f78 tempest-VolumesNegativeTest-992612787 tempest-VolumesNegativeTest-992612787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '479bda47e66544e8bfa47dad8294c180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '478dbeee61b6401c9dbb31c216ce537b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:29:49.325388 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-4a681afc-9e1b-44c1-b7ee-84437ccd5f78 tempest-VolumesNegativeTest-992612787 tempest-VolumesNegativeTest-992612787-project] 10.222.0.30 "GET /compute/v2.1/servers/b626d1e4-c5fd-47aa-be1f-4dbd8c2d50b5" status: 200 len: 1464 microversion: 2.1 time: 0.294954 Jun 16 18:29:49.326549 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 96/178] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:29:49 2022] GET /compute/v2.1/servers/b626d1e4-c5fd-47aa-be1f-4dbd8c2d50b5 => generated 1464 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:29:49.597987 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-e5f80731-bd27-4049-8114-80afaab05bbf tempest-VolumesNegativeTest-992612787 tempest-VolumesNegativeTest-992612787-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:29:49.598652 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-e5f80731-bd27-4049-8114-80afaab05bbf tempest-VolumesNegativeTest-992612787 tempest-VolumesNegativeTest-992612787-project] [instance: b626d1e4-c5fd-47aa-be1f-4dbd8c2d50b5] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:29:49.614256 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-e5f80731-bd27-4049-8114-80afaab05bbf tempest-VolumesNegativeTest-992612787 tempest-VolumesNegativeTest-992612787-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:49.614974 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-e5f80731-bd27-4049-8114-80afaab05bbf tempest-VolumesNegativeTest-992612787 tempest-VolumesNegativeTest-992612787-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:49.615908 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-e5f80731-bd27-4049-8114-80afaab05bbf tempest-VolumesNegativeTest-992612787 tempest-VolumesNegativeTest-992612787-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:49.616532 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-e5f80731-bd27-4049-8114-80afaab05bbf tempest-VolumesNegativeTest-992612787 tempest-VolumesNegativeTest-992612787-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:49.671886 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-e5f80731-bd27-4049-8114-80afaab05bbf tempest-VolumesNegativeTest-992612787 tempest-VolumesNegativeTest-992612787-project] [instance: b626d1e4-c5fd-47aa-be1f-4dbd8c2d50b5] Going to try to terminate instance {{(pid=117671) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 18:29:49.748179 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-8f3cd51f-5a8d-41c4-99d5-b376690e95b9 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:29:49.750005 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-8f3cd51f-5a8d-41c4-99d5-b376690e95b9 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] [instance: 651b5fe1-0df7-4bc6-b18e-7caea544a93f] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:29:49.773807 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-8f3cd51f-5a8d-41c4-99d5-b376690e95b9 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:49.774978 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-8f3cd51f-5a8d-41c4-99d5-b376690e95b9 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:49.783834 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-8f3cd51f-5a8d-41c4-99d5-b376690e95b9 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:49.787570 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-8f3cd51f-5a8d-41c4-99d5-b376690e95b9 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:49.865477 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG dbcounter [-] [117671] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=117671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:29:49.979307 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-e5f80731-bd27-4049-8114-80afaab05bbf tempest-VolumesNegativeTest-992612787 tempest-VolumesNegativeTest-992612787-project] 10.222.0.30 "DELETE /compute/v2.1/servers/b626d1e4-c5fd-47aa-be1f-4dbd8c2d50b5" status: 204 len: 0 microversion: 2.1 time: 0.378124 Jun 16 18:29:49.986067 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 83/179] 10.222.0.30 () {58 vars in 1238 bytes} [Thu Jun 16 18:29:49 2022] DELETE /compute/v2.1/servers/b626d1e4-c5fd-47aa-be1f-4dbd8c2d50b5 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 18:29:49.995417 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-84e1dc57-3f46-4d64-a17b-b2d42fd6b31e tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:29:49.996310 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-84e1dc57-3f46-4d64-a17b-b2d42fd6b31e tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] [instance: 05981bed-b625-4e9a-b860-6a7ce1288e8d] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:29:50.019600 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-84e1dc57-3f46-4d64-a17b-b2d42fd6b31e tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:50.026764 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-84e1dc57-3f46-4d64-a17b-b2d42fd6b31e tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:50.028001 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-84e1dc57-3f46-4d64-a17b-b2d42fd6b31e tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:50.028609 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-84e1dc57-3f46-4d64-a17b-b2d42fd6b31e tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:50.171924 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-8f3cd51f-5a8d-41c4-99d5-b376690e95b9 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:29:50.196609 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-8f3cd51f-5a8d-41c4-99d5-b376690e95b9 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:29:50.200358 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-8f3cd51f-5a8d-41c4-99d5-b376690e95b9 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:29:50.202269 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-8f3cd51f-5a8d-41c4-99d5-b376690e95b9 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] 10.222.0.30 "GET /compute/v2.1/servers/651b5fe1-0df7-4bc6-b18e-7caea544a93f" status: 200 len: 1407 microversion: 2.20 time: 0.460525 Jun 16 18:29:50.203129 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 97/180] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Jun 16 18:29:49 2022] GET /compute/v2.1/servers/651b5fe1-0df7-4bc6-b18e-7caea544a93f => generated 1407 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:29:50.222317 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-7588e835-7072-44da-a475-938670d85a58 tempest-VolumesNegativeTest-992612787 tempest-VolumesNegativeTest-992612787-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:29:50.223393 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-7588e835-7072-44da-a475-938670d85a58 tempest-VolumesNegativeTest-992612787 tempest-VolumesNegativeTest-992612787-project] [instance: b626d1e4-c5fd-47aa-be1f-4dbd8c2d50b5] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:29:50.233312 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-7588e835-7072-44da-a475-938670d85a58 tempest-VolumesNegativeTest-992612787 tempest-VolumesNegativeTest-992612787-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:50.234068 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-7588e835-7072-44da-a475-938670d85a58 tempest-VolumesNegativeTest-992612787 tempest-VolumesNegativeTest-992612787-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:50.235571 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-7588e835-7072-44da-a475-938670d85a58 tempest-VolumesNegativeTest-992612787 tempest-VolumesNegativeTest-992612787-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:50.236306 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-7588e835-7072-44da-a475-938670d85a58 tempest-VolumesNegativeTest-992612787 tempest-VolumesNegativeTest-992612787-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:50.300763 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-84e1dc57-3f46-4d64-a17b-b2d42fd6b31e tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512f01cca14b447c8f6c9eebbd828eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70bbccf07e3404cb94ba59201061a6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:29:50.316874 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-84e1dc57-3f46-4d64-a17b-b2d42fd6b31e tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] 10.222.0.30 "GET /compute/v2.1/servers/05981bed-b625-4e9a-b860-6a7ce1288e8d" status: 200 len: 1522 microversion: 2.1 time: 0.329276 Jun 16 18:29:50.318079 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 84/181] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:29:49 2022] GET /compute/v2.1/servers/05981bed-b625-4e9a-b860-6a7ce1288e8d => generated 1522 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:29:50.591848 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-7588e835-7072-44da-a475-938670d85a58 tempest-VolumesNegativeTest-992612787 tempest-VolumesNegativeTest-992612787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '479bda47e66544e8bfa47dad8294c180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '478dbeee61b6401c9dbb31c216ce537b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:29:50.606246 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-7588e835-7072-44da-a475-938670d85a58 tempest-VolumesNegativeTest-992612787 tempest-VolumesNegativeTest-992612787-project] 10.222.0.30 "GET /compute/v2.1/servers/b626d1e4-c5fd-47aa-be1f-4dbd8c2d50b5" status: 200 len: 1470 microversion: 2.1 time: 0.389604 Jun 16 18:29:50.617322 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 98/182] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:29:50 2022] GET /compute/v2.1/servers/b626d1e4-c5fd-47aa-be1f-4dbd8c2d50b5 => generated 1470 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:29:51.227000 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-6bb1f5f0-d553-41e3-854e-3eed31a36d3f tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:29:51.228035 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-6bb1f5f0-d553-41e3-854e-3eed31a36d3f tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] [instance: 651b5fe1-0df7-4bc6-b18e-7caea544a93f] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:29:51.239184 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-6bb1f5f0-d553-41e3-854e-3eed31a36d3f tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:51.240122 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-6bb1f5f0-d553-41e3-854e-3eed31a36d3f tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:51.241270 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-6bb1f5f0-d553-41e3-854e-3eed31a36d3f tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:51.241912 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-6bb1f5f0-d553-41e3-854e-3eed31a36d3f tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:51.336490 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-3c9338e9-7ea5-415e-b5fd-cd010dfa28a9 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:29:51.337126 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-3c9338e9-7ea5-415e-b5fd-cd010dfa28a9 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] [instance: 05981bed-b625-4e9a-b860-6a7ce1288e8d] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:29:51.354177 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-3c9338e9-7ea5-415e-b5fd-cd010dfa28a9 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:51.358395 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-3c9338e9-7ea5-415e-b5fd-cd010dfa28a9 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:51.359452 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-3c9338e9-7ea5-415e-b5fd-cd010dfa28a9 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:51.363008 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-3c9338e9-7ea5-415e-b5fd-cd010dfa28a9 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:51.469362 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-6bb1f5f0-d553-41e3-854e-3eed31a36d3f tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:29:51.481599 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-6bb1f5f0-d553-41e3-854e-3eed31a36d3f tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:29:51.493093 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-6bb1f5f0-d553-41e3-854e-3eed31a36d3f tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:29:51.495750 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-6bb1f5f0-d553-41e3-854e-3eed31a36d3f tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] 10.222.0.30 "GET /compute/v2.1/servers/651b5fe1-0df7-4bc6-b18e-7caea544a93f" status: 200 len: 1599 microversion: 2.20 time: 0.275474 Jun 16 18:29:51.496773 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 85/183] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Jun 16 18:29:51 2022] GET /compute/v2.1/servers/651b5fe1-0df7-4bc6-b18e-7caea544a93f => generated 1599 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:29:51.535158 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-72b70138-5157-47fd-9148-3bbbff029099 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:29:51.536189 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-72b70138-5157-47fd-9148-3bbbff029099 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] [instance: 651b5fe1-0df7-4bc6-b18e-7caea544a93f] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:29:51.546577 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-72b70138-5157-47fd-9148-3bbbff029099 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:51.547088 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-72b70138-5157-47fd-9148-3bbbff029099 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:51.547920 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-72b70138-5157-47fd-9148-3bbbff029099 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:51.548842 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-72b70138-5157-47fd-9148-3bbbff029099 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:51.664568 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-3c9338e9-7ea5-415e-b5fd-cd010dfa28a9 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512f01cca14b447c8f6c9eebbd828eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70bbccf07e3404cb94ba59201061a6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:29:51.682357 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-3c9338e9-7ea5-415e-b5fd-cd010dfa28a9 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] 10.222.0.30 "GET /compute/v2.1/servers/05981bed-b625-4e9a-b860-6a7ce1288e8d" status: 200 len: 1522 microversion: 2.1 time: 0.349126 Jun 16 18:29:51.683946 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 99/184] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:29:51 2022] GET /compute/v2.1/servers/05981bed-b625-4e9a-b860-6a7ce1288e8d => generated 1522 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:29:51.696589 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-72b70138-5157-47fd-9148-3bbbff029099 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] 10.222.0.30 "GET /compute/v2.1/servers/651b5fe1-0df7-4bc6-b18e-7caea544a93f/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.167558 Jun 16 18:29:51.696589 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 86/185] 10.222.0.30 () {60 vars in 1315 bytes} [Thu Jun 16 18:29:51 2022] GET /compute/v2.1/servers/651b5fe1-0df7-4bc6-b18e-7caea544a93f/os-interface => generated 285 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 18:29:51.696589 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-35e2c21d-1444-4008-bcf2-b9b420739692 tempest-VolumesNegativeTest-992612787 tempest-VolumesNegativeTest-992612787-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:29:51.697309 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-35e2c21d-1444-4008-bcf2-b9b420739692 tempest-VolumesNegativeTest-992612787 tempest-VolumesNegativeTest-992612787-project] [instance: b626d1e4-c5fd-47aa-be1f-4dbd8c2d50b5] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:29:51.708922 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-35e2c21d-1444-4008-bcf2-b9b420739692 tempest-VolumesNegativeTest-992612787 tempest-VolumesNegativeTest-992612787-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:51.709383 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-35e2c21d-1444-4008-bcf2-b9b420739692 tempest-VolumesNegativeTest-992612787 tempest-VolumesNegativeTest-992612787-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:51.710587 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-35e2c21d-1444-4008-bcf2-b9b420739692 tempest-VolumesNegativeTest-992612787 tempest-VolumesNegativeTest-992612787-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:51.711208 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-35e2c21d-1444-4008-bcf2-b9b420739692 tempest-VolumesNegativeTest-992612787 tempest-VolumesNegativeTest-992612787-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:52.212707 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-35e2c21d-1444-4008-bcf2-b9b420739692 tempest-VolumesNegativeTest-992612787 tempest-VolumesNegativeTest-992612787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '479bda47e66544e8bfa47dad8294c180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '478dbeee61b6401c9dbb31c216ce537b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:29:52.240180 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-35e2c21d-1444-4008-bcf2-b9b420739692 tempest-VolumesNegativeTest-992612787 tempest-VolumesNegativeTest-992612787-project] 10.222.0.30 "GET /compute/v2.1/servers/b626d1e4-c5fd-47aa-be1f-4dbd8c2d50b5" status: 200 len: 1470 microversion: 2.1 time: 0.547765 Jun 16 18:29:52.242077 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 87/186] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:29:51 2022] GET /compute/v2.1/servers/b626d1e4-c5fd-47aa-be1f-4dbd8c2d50b5 => generated 1470 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:29:52.723409 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-f1f6ffcd-9c2d-4396-b701-d72979e8636c tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:29:52.724493 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-f1f6ffcd-9c2d-4396-b701-d72979e8636c tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] [instance: 05981bed-b625-4e9a-b860-6a7ce1288e8d] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:29:52.736436 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-f1f6ffcd-9c2d-4396-b701-d72979e8636c tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:52.737542 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-f1f6ffcd-9c2d-4396-b701-d72979e8636c tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:52.738395 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-f1f6ffcd-9c2d-4396-b701-d72979e8636c tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:52.738825 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-f1f6ffcd-9c2d-4396-b701-d72979e8636c tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:53.203234 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-f1f6ffcd-9c2d-4396-b701-d72979e8636c tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512f01cca14b447c8f6c9eebbd828eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70bbccf07e3404cb94ba59201061a6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:29:53.220224 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-f1f6ffcd-9c2d-4396-b701-d72979e8636c tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] 10.222.0.30 "GET /compute/v2.1/servers/05981bed-b625-4e9a-b860-6a7ce1288e8d" status: 200 len: 1522 microversion: 2.1 time: 0.503825 Jun 16 18:29:53.221584 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 100/187] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:29:52 2022] GET /compute/v2.1/servers/05981bed-b625-4e9a-b860-6a7ce1288e8d => generated 1522 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:29:53.278795 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-3110758e-9648-4fcf-ab69-7477d4961b02 tempest-VolumesNegativeTest-992612787 tempest-VolumesNegativeTest-992612787-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:29:53.280303 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-3110758e-9648-4fcf-ab69-7477d4961b02 tempest-VolumesNegativeTest-992612787 tempest-VolumesNegativeTest-992612787-project] [instance: b626d1e4-c5fd-47aa-be1f-4dbd8c2d50b5] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:29:53.298859 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-3110758e-9648-4fcf-ab69-7477d4961b02 tempest-VolumesNegativeTest-992612787 tempest-VolumesNegativeTest-992612787-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:53.299819 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-3110758e-9648-4fcf-ab69-7477d4961b02 tempest-VolumesNegativeTest-992612787 tempest-VolumesNegativeTest-992612787-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:53.301564 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-3110758e-9648-4fcf-ab69-7477d4961b02 tempest-VolumesNegativeTest-992612787 tempest-VolumesNegativeTest-992612787-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:53.302352 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-3110758e-9648-4fcf-ab69-7477d4961b02 tempest-VolumesNegativeTest-992612787 tempest-VolumesNegativeTest-992612787-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:53.647927 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-3110758e-9648-4fcf-ab69-7477d4961b02 tempest-VolumesNegativeTest-992612787 tempest-VolumesNegativeTest-992612787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '479bda47e66544e8bfa47dad8294c180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '478dbeee61b6401c9dbb31c216ce537b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:29:53.661184 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-3110758e-9648-4fcf-ab69-7477d4961b02 tempest-VolumesNegativeTest-992612787 tempest-VolumesNegativeTest-992612787-project] 10.222.0.30 "GET /compute/v2.1/servers/b626d1e4-c5fd-47aa-be1f-4dbd8c2d50b5" status: 200 len: 1470 microversion: 2.1 time: 0.396813 Jun 16 18:29:53.662906 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 88/188] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:29:53 2022] GET /compute/v2.1/servers/b626d1e4-c5fd-47aa-be1f-4dbd8c2d50b5 => generated 1470 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:29:54.250257 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-cd97dbbb-212b-46d8-bb59-dc12fe5b20f6 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:29:54.252033 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-cd97dbbb-212b-46d8-bb59-dc12fe5b20f6 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] [instance: 05981bed-b625-4e9a-b860-6a7ce1288e8d] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:29:54.263416 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-cd97dbbb-212b-46d8-bb59-dc12fe5b20f6 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:54.267134 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-cd97dbbb-212b-46d8-bb59-dc12fe5b20f6 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:54.268213 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-cd97dbbb-212b-46d8-bb59-dc12fe5b20f6 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:54.271303 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-cd97dbbb-212b-46d8-bb59-dc12fe5b20f6 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:54.689283 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-3ffb21a3-f8d1-4559-9b99-d06862c2c927 tempest-VolumesNegativeTest-992612787 tempest-VolumesNegativeTest-992612787-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:29:54.690144 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-3ffb21a3-f8d1-4559-9b99-d06862c2c927 tempest-VolumesNegativeTest-992612787 tempest-VolumesNegativeTest-992612787-project] [instance: b626d1e4-c5fd-47aa-be1f-4dbd8c2d50b5] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:29:54.701901 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-3ffb21a3-f8d1-4559-9b99-d06862c2c927 tempest-VolumesNegativeTest-992612787 tempest-VolumesNegativeTest-992612787-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:54.702334 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-3ffb21a3-f8d1-4559-9b99-d06862c2c927 tempest-VolumesNegativeTest-992612787 tempest-VolumesNegativeTest-992612787-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:54.709227 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-3ffb21a3-f8d1-4559-9b99-d06862c2c927 tempest-VolumesNegativeTest-992612787 tempest-VolumesNegativeTest-992612787-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:54.709934 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-3ffb21a3-f8d1-4559-9b99-d06862c2c927 tempest-VolumesNegativeTest-992612787 tempest-VolumesNegativeTest-992612787-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:55.076969 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-3ffb21a3-f8d1-4559-9b99-d06862c2c927 tempest-VolumesNegativeTest-992612787 tempest-VolumesNegativeTest-992612787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '479bda47e66544e8bfa47dad8294c180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '478dbeee61b6401c9dbb31c216ce537b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:29:55.090753 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-3ffb21a3-f8d1-4559-9b99-d06862c2c927 tempest-VolumesNegativeTest-992612787 tempest-VolumesNegativeTest-992612787-project] 10.222.0.30 "GET /compute/v2.1/servers/b626d1e4-c5fd-47aa-be1f-4dbd8c2d50b5" status: 200 len: 1470 microversion: 2.1 time: 0.405230 Jun 16 18:29:55.092475 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 89/189] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:29:54 2022] GET /compute/v2.1/servers/b626d1e4-c5fd-47aa-be1f-4dbd8c2d50b5 => generated 1470 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:29:55.100336 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-0eae7262-f2ce-46bc-a18b-9a3a23d76283 tempest-DeleteServersTestJSON-823268338 tempest-DeleteServersTestJSON-823268338-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:29:55.101578 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-0eae7262-f2ce-46bc-a18b-9a3a23d76283 tempest-DeleteServersTestJSON-823268338 tempest-DeleteServersTestJSON-823268338-project] [instance: 58790243-9fe3-49d2-b029-40825911ddde] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:29:55.114645 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-0eae7262-f2ce-46bc-a18b-9a3a23d76283 tempest-DeleteServersTestJSON-823268338 tempest-DeleteServersTestJSON-823268338-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:55.116435 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-0eae7262-f2ce-46bc-a18b-9a3a23d76283 tempest-DeleteServersTestJSON-823268338 tempest-DeleteServersTestJSON-823268338-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:55.118553 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-0eae7262-f2ce-46bc-a18b-9a3a23d76283 tempest-DeleteServersTestJSON-823268338 tempest-DeleteServersTestJSON-823268338-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:55.120238 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-0eae7262-f2ce-46bc-a18b-9a3a23d76283 tempest-DeleteServersTestJSON-823268338 tempest-DeleteServersTestJSON-823268338-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:55.272040 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-cd97dbbb-212b-46d8-bb59-dc12fe5b20f6 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512f01cca14b447c8f6c9eebbd828eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70bbccf07e3404cb94ba59201061a6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:29:55.310237 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-cd97dbbb-212b-46d8-bb59-dc12fe5b20f6 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] 10.222.0.30 "GET /compute/v2.1/servers/05981bed-b625-4e9a-b860-6a7ce1288e8d" status: 200 len: 1522 microversion: 2.1 time: 1.061483 Jun 16 18:29:55.313931 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 101/190] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:29:54 2022] GET /compute/v2.1/servers/05981bed-b625-4e9a-b860-6a7ce1288e8d => generated 1522 bytes in 1068 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:29:55.349062 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-0eae7262-f2ce-46bc-a18b-9a3a23d76283 tempest-DeleteServersTestJSON-823268338 tempest-DeleteServersTestJSON-823268338-project] [instance: 58790243-9fe3-49d2-b029-40825911ddde] Going to try to terminate instance {{(pid=117671) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 18:29:55.507708 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-0eae7262-f2ce-46bc-a18b-9a3a23d76283 tempest-DeleteServersTestJSON-823268338 tempest-DeleteServersTestJSON-823268338-project] 10.222.0.30 "DELETE /compute/v2.1/servers/58790243-9fe3-49d2-b029-40825911ddde" status: 204 len: 0 microversion: 2.1 time: 0.412942 Jun 16 18:29:55.510348 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 90/191] 10.222.0.30 () {58 vars in 1238 bytes} [Thu Jun 16 18:29:55 2022] DELETE /compute/v2.1/servers/58790243-9fe3-49d2-b029-40825911ddde => generated 0 bytes in 416 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 18:29:55.524432 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-63eb7817-bf31-4e6d-b236-aeb0f99cc6a0 tempest-DeleteServersTestJSON-823268338 tempest-DeleteServersTestJSON-823268338-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:29:55.526327 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-63eb7817-bf31-4e6d-b236-aeb0f99cc6a0 tempest-DeleteServersTestJSON-823268338 tempest-DeleteServersTestJSON-823268338-project] [instance: 58790243-9fe3-49d2-b029-40825911ddde] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:29:55.551306 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-63eb7817-bf31-4e6d-b236-aeb0f99cc6a0 tempest-DeleteServersTestJSON-823268338 tempest-DeleteServersTestJSON-823268338-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:55.552273 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-63eb7817-bf31-4e6d-b236-aeb0f99cc6a0 tempest-DeleteServersTestJSON-823268338 tempest-DeleteServersTestJSON-823268338-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:55.554585 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-63eb7817-bf31-4e6d-b236-aeb0f99cc6a0 tempest-DeleteServersTestJSON-823268338 tempest-DeleteServersTestJSON-823268338-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:55.555786 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-63eb7817-bf31-4e6d-b236-aeb0f99cc6a0 tempest-DeleteServersTestJSON-823268338 tempest-DeleteServersTestJSON-823268338-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:55.651523 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [req-58d6f319-fe60-487b-ae19-ebc6f9334157 req-946f5fb2-af07-48d4-9e88-43c4c4054283 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "651b5fe1-0df7-4bc6-b18e-7caea544a93f", "tag": "7416c7c3-1e79-4777-a950-c0c27847ca8e"}]} {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:29:55.669947 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [req-58d6f319-fe60-487b-ae19-ebc6f9334157 req-946f5fb2-af07-48d4-9e88-43c4c4054283 service nova] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:55.674981 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [req-58d6f319-fe60-487b-ae19-ebc6f9334157 req-946f5fb2-af07-48d4-9e88-43c4c4054283 service nova] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:55.731240 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.compute.server_external_events [req-58d6f319-fe60-487b-ae19-ebc6f9334157 req-946f5fb2-af07-48d4-9e88-43c4c4054283 service nova] Creating event network-changed:7416c7c3-1e79-4777-a950-c0c27847ca8e for instance 651b5fe1-0df7-4bc6-b18e-7caea544a93f on hv-cinder-81322 Jun 16 18:29:55.754194 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [req-58d6f319-fe60-487b-ae19-ebc6f9334157 req-946f5fb2-af07-48d4-9e88-43c4c4054283 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.112489 Jun 16 18:29:55.754933 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 91/192] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Jun 16 18:29:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:29:56.125383 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-26379302-dbcd-41d3-bd92-654c170932d6 tempest-VolumesNegativeTest-992612787 tempest-VolumesNegativeTest-992612787-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:29:56.127823 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-26379302-dbcd-41d3-bd92-654c170932d6 tempest-VolumesNegativeTest-992612787 tempest-VolumesNegativeTest-992612787-project] [instance: b626d1e4-c5fd-47aa-be1f-4dbd8c2d50b5] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:29:56.156025 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-26379302-dbcd-41d3-bd92-654c170932d6 tempest-VolumesNegativeTest-992612787 tempest-VolumesNegativeTest-992612787-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:56.156867 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-26379302-dbcd-41d3-bd92-654c170932d6 tempest-VolumesNegativeTest-992612787 tempest-VolumesNegativeTest-992612787-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:56.165561 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-26379302-dbcd-41d3-bd92-654c170932d6 tempest-VolumesNegativeTest-992612787 tempest-VolumesNegativeTest-992612787-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:56.166161 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-26379302-dbcd-41d3-bd92-654c170932d6 tempest-VolumesNegativeTest-992612787 tempest-VolumesNegativeTest-992612787-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:56.221870 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-63eb7817-bf31-4e6d-b236-aeb0f99cc6a0 tempest-DeleteServersTestJSON-823268338 tempest-DeleteServersTestJSON-823268338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee9c06c774f478db33c16b784d6b914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa9111175cad44b2bbc611b7ae36a991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:29:56.243206 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-63eb7817-bf31-4e6d-b236-aeb0f99cc6a0 tempest-DeleteServersTestJSON-823268338 tempest-DeleteServersTestJSON-823268338-project] 10.222.0.30 "GET /compute/v2.1/servers/58790243-9fe3-49d2-b029-40825911ddde" status: 200 len: 1553 microversion: 2.1 time: 0.726764 Jun 16 18:29:56.248459 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 102/193] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:29:55 2022] GET /compute/v2.1/servers/58790243-9fe3-49d2-b029-40825911ddde => generated 1553 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:29:56.335998 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-adb90524-0893-4f25-b3a8-7c36f00390ed tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:29:56.338007 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-adb90524-0893-4f25-b3a8-7c36f00390ed tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] [instance: 05981bed-b625-4e9a-b860-6a7ce1288e8d] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:29:56.348522 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-adb90524-0893-4f25-b3a8-7c36f00390ed tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:56.352113 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-adb90524-0893-4f25-b3a8-7c36f00390ed tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:56.354309 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-adb90524-0893-4f25-b3a8-7c36f00390ed tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:56.355179 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-adb90524-0893-4f25-b3a8-7c36f00390ed tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:56.373887 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-26379302-dbcd-41d3-bd92-654c170932d6 tempest-VolumesNegativeTest-992612787 tempest-VolumesNegativeTest-992612787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '479bda47e66544e8bfa47dad8294c180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '478dbeee61b6401c9dbb31c216ce537b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:29:56.395889 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG dbcounter [-] [117670] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:29:56.406830 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-26379302-dbcd-41d3-bd92-654c170932d6 tempest-VolumesNegativeTest-992612787 tempest-VolumesNegativeTest-992612787-project] 10.222.0.30 "GET /compute/v2.1/servers/b626d1e4-c5fd-47aa-be1f-4dbd8c2d50b5" status: 200 len: 1428 microversion: 2.1 time: 0.299580 Jun 16 18:29:56.420687 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 92/194] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:29:56 2022] GET /compute/v2.1/servers/b626d1e4-c5fd-47aa-be1f-4dbd8c2d50b5 => generated 1428 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:29:56.595758 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-adb90524-0893-4f25-b3a8-7c36f00390ed tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512f01cca14b447c8f6c9eebbd828eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70bbccf07e3404cb94ba59201061a6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:29:56.608710 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-adb90524-0893-4f25-b3a8-7c36f00390ed tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] 10.222.0.30 "GET /compute/v2.1/servers/05981bed-b625-4e9a-b860-6a7ce1288e8d" status: 200 len: 1522 microversion: 2.1 time: 0.277232 Jun 16 18:29:56.620096 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 103/195] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:29:56 2022] GET /compute/v2.1/servers/05981bed-b625-4e9a-b860-6a7ce1288e8d => generated 1522 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:29:57.275581 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-5e6393ff-e9cb-4a8b-9bf9-f2f8158e3361 tempest-DeleteServersTestJSON-823268338 tempest-DeleteServersTestJSON-823268338-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:29:57.276812 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-5e6393ff-e9cb-4a8b-9bf9-f2f8158e3361 tempest-DeleteServersTestJSON-823268338 tempest-DeleteServersTestJSON-823268338-project] [instance: 58790243-9fe3-49d2-b029-40825911ddde] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:29:57.309868 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-5e6393ff-e9cb-4a8b-9bf9-f2f8158e3361 tempest-DeleteServersTestJSON-823268338 tempest-DeleteServersTestJSON-823268338-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:57.311092 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-5e6393ff-e9cb-4a8b-9bf9-f2f8158e3361 tempest-DeleteServersTestJSON-823268338 tempest-DeleteServersTestJSON-823268338-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:57.317076 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-5e6393ff-e9cb-4a8b-9bf9-f2f8158e3361 tempest-DeleteServersTestJSON-823268338 tempest-DeleteServersTestJSON-823268338-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:57.318208 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-5e6393ff-e9cb-4a8b-9bf9-f2f8158e3361 tempest-DeleteServersTestJSON-823268338 tempest-DeleteServersTestJSON-823268338-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:57.440913 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-f2e37cf7-cf3a-4678-b19d-816081d37690 tempest-VolumesNegativeTest-992612787 tempest-VolumesNegativeTest-992612787-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:29:57.448485 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-f2e37cf7-cf3a-4678-b19d-816081d37690 tempest-VolumesNegativeTest-992612787 tempest-VolumesNegativeTest-992612787-project] [instance: b626d1e4-c5fd-47aa-be1f-4dbd8c2d50b5] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:29:57.521527 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-f2e37cf7-cf3a-4678-b19d-816081d37690 tempest-VolumesNegativeTest-992612787 tempest-VolumesNegativeTest-992612787-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:57.522342 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-f2e37cf7-cf3a-4678-b19d-816081d37690 tempest-VolumesNegativeTest-992612787 tempest-VolumesNegativeTest-992612787-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:57.523819 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-f2e37cf7-cf3a-4678-b19d-816081d37690 tempest-VolumesNegativeTest-992612787 tempest-VolumesNegativeTest-992612787-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:57.550304 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-f2e37cf7-cf3a-4678-b19d-816081d37690 tempest-VolumesNegativeTest-992612787 tempest-VolumesNegativeTest-992612787-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:57.680518 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-f2e37cf7-cf3a-4678-b19d-816081d37690 tempest-VolumesNegativeTest-992612787 tempest-VolumesNegativeTest-992612787-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:57.681944 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-f2e37cf7-cf3a-4678-b19d-816081d37690 tempest-VolumesNegativeTest-992612787 tempest-VolumesNegativeTest-992612787-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:57.683159 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.objects.instance [None req-f2e37cf7-cf3a-4678-b19d-816081d37690 tempest-VolumesNegativeTest-992612787 tempest-VolumesNegativeTest-992612787-project] Lazy-loading 'fault' on Instance uuid b626d1e4-c5fd-47aa-be1f-4dbd8c2d50b5 {{(pid=117670) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 18:29:57.968966 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-5e6393ff-e9cb-4a8b-9bf9-f2f8158e3361 tempest-DeleteServersTestJSON-823268338 tempest-DeleteServersTestJSON-823268338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee9c06c774f478db33c16b784d6b914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa9111175cad44b2bbc611b7ae36a991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:29:57.996622 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-5e6393ff-e9cb-4a8b-9bf9-f2f8158e3361 tempest-DeleteServersTestJSON-823268338 tempest-DeleteServersTestJSON-823268338-project] 10.222.0.30 "GET /compute/v2.1/servers/58790243-9fe3-49d2-b029-40825911ddde" status: 200 len: 1553 microversion: 2.1 time: 0.731810 Jun 16 18:29:58.037015 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 93/196] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:29:57 2022] GET /compute/v2.1/servers/58790243-9fe3-49d2-b029-40825911ddde => generated 1553 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:29:58.047090 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-f2e37cf7-cf3a-4678-b19d-816081d37690 tempest-VolumesNegativeTest-992612787 tempest-VolumesNegativeTest-992612787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '479bda47e66544e8bfa47dad8294c180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '478dbeee61b6401c9dbb31c216ce537b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:29:58.064300 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-50a6f7b5-028b-4d0b-b04d-d1f815f1a5ce tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:29:58.080242 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-50a6f7b5-028b-4d0b-b04d-d1f815f1a5ce tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] [instance: 05981bed-b625-4e9a-b860-6a7ce1288e8d] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:29:58.095422 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-f2e37cf7-cf3a-4678-b19d-816081d37690 tempest-VolumesNegativeTest-992612787 tempest-VolumesNegativeTest-992612787-project] 10.222.0.30 "GET /compute/v2.1/servers/b626d1e4-c5fd-47aa-be1f-4dbd8c2d50b5" status: 200 len: 1305 microversion: 2.1 time: 0.661249 Jun 16 18:29:58.097873 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-50a6f7b5-028b-4d0b-b04d-d1f815f1a5ce tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:58.101133 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-50a6f7b5-028b-4d0b-b04d-d1f815f1a5ce tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:58.105382 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-50a6f7b5-028b-4d0b-b04d-d1f815f1a5ce tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:58.111266 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-50a6f7b5-028b-4d0b-b04d-d1f815f1a5ce tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:58.111583 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 104/197] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:29:57 2022] GET /compute/v2.1/servers/b626d1e4-c5fd-47aa-be1f-4dbd8c2d50b5 => generated 1305 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:29:58.146349 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [req-9a0131fb-c691-4009-8dc2-a64e141b9844 req-616b4563-22dc-4f00-9623-912f26275ae0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b626d1e4-c5fd-47aa-be1f-4dbd8c2d50b5", "name": "network-vif-deleted", "tag": "e304be79-1d40-45f4-99ca-97459a28a681"}]} {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:29:58.206595 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [req-9a0131fb-c691-4009-8dc2-a64e141b9844 req-616b4563-22dc-4f00-9623-912f26275ae0 service nova] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:58.209541 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [req-9a0131fb-c691-4009-8dc2-a64e141b9844 req-616b4563-22dc-4f00-9623-912f26275ae0 service nova] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:58.275004 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.compute.server_external_events [req-9a0131fb-c691-4009-8dc2-a64e141b9844 req-616b4563-22dc-4f00-9623-912f26275ae0 service nova] Creating event network-vif-deleted:e304be79-1d40-45f4-99ca-97459a28a681 for instance b626d1e4-c5fd-47aa-be1f-4dbd8c2d50b5 on hv-cinder-81322 Jun 16 18:29:58.300091 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [req-9a0131fb-c691-4009-8dc2-a64e141b9844 req-616b4563-22dc-4f00-9623-912f26275ae0 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.169827 Jun 16 18:29:58.301222 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 105/198] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Jun 16 18:29:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:29:58.526451 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-50a6f7b5-028b-4d0b-b04d-d1f815f1a5ce tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512f01cca14b447c8f6c9eebbd828eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70bbccf07e3404cb94ba59201061a6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:29:58.545176 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-50a6f7b5-028b-4d0b-b04d-d1f815f1a5ce tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] 10.222.0.30 "GET /compute/v2.1/servers/05981bed-b625-4e9a-b860-6a7ce1288e8d" status: 200 len: 1522 microversion: 2.1 time: 0.502469 Jun 16 18:29:58.546355 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 94/199] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:29:58 2022] GET /compute/v2.1/servers/05981bed-b625-4e9a-b860-6a7ce1288e8d => generated 1522 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:29:59.040363 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-e50592a4-2e0a-43c8-b4dd-c9654b744205 tempest-DeleteServersTestJSON-823268338 tempest-DeleteServersTestJSON-823268338-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:29:59.043655 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-e50592a4-2e0a-43c8-b4dd-c9654b744205 tempest-DeleteServersTestJSON-823268338 tempest-DeleteServersTestJSON-823268338-project] [instance: 58790243-9fe3-49d2-b029-40825911ddde] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:29:59.057853 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-e50592a4-2e0a-43c8-b4dd-c9654b744205 tempest-DeleteServersTestJSON-823268338 tempest-DeleteServersTestJSON-823268338-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:59.058666 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-e50592a4-2e0a-43c8-b4dd-c9654b744205 tempest-DeleteServersTestJSON-823268338 tempest-DeleteServersTestJSON-823268338-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:59.061189 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-e50592a4-2e0a-43c8-b4dd-c9654b744205 tempest-DeleteServersTestJSON-823268338 tempest-DeleteServersTestJSON-823268338-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:59.061189 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-e50592a4-2e0a-43c8-b4dd-c9654b744205 tempest-DeleteServersTestJSON-823268338 tempest-DeleteServersTestJSON-823268338-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:59.137345 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-ba1e2bac-54ef-4678-8e05-9e32d9ed4e2d tempest-VolumesNegativeTest-992612787 tempest-VolumesNegativeTest-992612787-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:29:59.138475 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-ba1e2bac-54ef-4678-8e05-9e32d9ed4e2d tempest-VolumesNegativeTest-992612787 tempest-VolumesNegativeTest-992612787-project] [instance: b626d1e4-c5fd-47aa-be1f-4dbd8c2d50b5] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:29:59.162045 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-ba1e2bac-54ef-4678-8e05-9e32d9ed4e2d tempest-VolumesNegativeTest-992612787 tempest-VolumesNegativeTest-992612787-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:59.162558 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-ba1e2bac-54ef-4678-8e05-9e32d9ed4e2d tempest-VolumesNegativeTest-992612787 tempest-VolumesNegativeTest-992612787-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:59.164306 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-ba1e2bac-54ef-4678-8e05-9e32d9ed4e2d tempest-VolumesNegativeTest-992612787 tempest-VolumesNegativeTest-992612787-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:59.165458 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-ba1e2bac-54ef-4678-8e05-9e32d9ed4e2d tempest-VolumesNegativeTest-992612787 tempest-VolumesNegativeTest-992612787-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:59.208172 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.wsgi [None req-ba1e2bac-54ef-4678-8e05-9e32d9ed4e2d tempest-VolumesNegativeTest-992612787 tempest-VolumesNegativeTest-992612787-project] HTTP exception thrown: Instance b626d1e4-c5fd-47aa-be1f-4dbd8c2d50b5 could not be found. Jun 16 18:29:59.227388 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-ba1e2bac-54ef-4678-8e05-9e32d9ed4e2d tempest-VolumesNegativeTest-992612787 tempest-VolumesNegativeTest-992612787-project] Request method failure captured: Jun 16 18:29:59.227388 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: request: GET /compute/v2.1/servers/b626d1e4-c5fd-47aa-be1f-4dbd8c2d50b5 HTTP/1.1 Jun 16 18:29:59.227388 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: Accept: application/json Jun 16 18:29:59.227388 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: Accept-Encoding: identity Jun 16 18:29:59.227388 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: Connection: close Jun 16 18:29:59.227388 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: Content-Length: 0 Jun 16 18:29:59.227388 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: Content-Type: application/json Jun 16 18:29:59.227388 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: Host: 10.222.0.30 Jun 16 18:29:59.227388 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: Openstack-System-Scope: None Jun 16 18:29:59.227388 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: User-Agent: python-urllib3/1.26.9 Jun 16 18:29:59.227388 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Auth-Token: gAAAAABiq3Zhg1wvM0gxNOGjE--qrdizG0mb2tOHcgHk2g6ky5Lbi-pcgmQx3Girv9BrBZzYszk0qhiCyCUYy79_SpjpEv1bSv7a0-K3xPOYUg1AQL9UsAe1_3qqziuhb-Xwev5lqAfG31148U0Z-MARZpRixBI8AvRPiVwTwcyq2g93Vfe0KXo Jun 16 18:29:59.227388 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Domain-Id: None Jun 16 18:29:59.227388 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Domain-Name: None Jun 16 18:29:59.227388 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Identity-Status: Confirmed Jun 16 18:29:59.227388 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Is-Admin-Project: True Jun 16 18:29:59.227388 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Project-Domain-Id: default Jun 16 18:29:59.227388 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Project-Domain-Name: Default Jun 16 18:29:59.227388 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Project-Id: 478dbeee61b6401c9dbb31c216ce537b Jun 16 18:29:59.227388 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Project-Name: tempest-VolumesNegativeTest-992612787 Jun 16 18:29:59.227388 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Role: reader,member Jun 16 18:29:59.227388 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Roles: reader,member Jun 16 18:29:59.230378 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/478dbeee61b6401c9dbb31c216ce537b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/478dbeee61b6401c9dbb31c216ce537b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_478dbeee61b6401c9dbb31c216ce537b", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/478dbeee61b6401c9dbb31c216ce537b"}]}] Jun 16 18:29:59.230378 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Tenant: tempest-VolumesNegativeTest-992612787 Jun 16 18:29:59.230378 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Tenant-Id: 478dbeee61b6401c9dbb31c216ce537b Jun 16 18:29:59.230378 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Tenant-Name: tempest-VolumesNegativeTest-992612787 Jun 16 18:29:59.230378 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-User: tempest-VolumesNegativeTest-992612787-project Jun 16 18:29:59.230378 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-User-Domain-Id: default Jun 16 18:29:59.230378 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-User-Domain-Name: Default Jun 16 18:29:59.230378 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-User-Id: 479bda47e66544e8bfa47dad8294c180 Jun 16 18:29:59.230378 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-User-Name: tempest-VolumesNegativeTest-992612787-project Jun 16 18:29:59.230378 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: method: > Jun 16 18:29:59.230378 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: exception: Instance b626d1e4-c5fd-47aa-be1f-4dbd8c2d50b5 could not be found. Jun 16 18:29:59.230378 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: action_args: {'id': 'b626d1e4-c5fd-47aa-be1f-4dbd8c2d50b5'} Jun 16 18:29:59.232119 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:29:59.232119 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:29:59.232119 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 18:29:59.232119 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 18:29:59.232119 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 18:29:59.232119 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 18:29:59.232119 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 18:29:59.232119 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 18:29:59.232119 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 18:29:59.232119 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 18:29:59.232119 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b626d1e4-c5fd-47aa-be1f-4dbd8c2d50b5 could not be found. Jun 16 18:29:59.232119 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Jun 16 18:29:59.232119 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:29:59.232119 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Jun 16 18:29:59.232119 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:29:59.232119 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:29:59.232119 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:29:59.232119 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:29:59.232119 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:29:59.232119 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:29:59.234991 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:29:59.234991 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 18:29:59.234991 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 18:29:59.234991 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 18:29:59.234991 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 18:29:59.234991 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 18:29:59.234991 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:29:59.234991 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b626d1e4-c5fd-47aa-be1f-4dbd8c2d50b5 could not be found. Jun 16 18:29:59.234991 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Jun 16 18:29:59.234991 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:29:59.234991 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Jun 16 18:29:59.234991 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:29:59.234991 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:29:59.234991 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:29:59.234991 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:29:59.234991 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:29:59.234991 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b626d1e4-c5fd-47aa-be1f-4dbd8c2d50b5 could not be found. Jun 16 18:29:59.234991 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Jun 16 18:29:59.245380 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-ba1e2bac-54ef-4678-8e05-9e32d9ed4e2d tempest-VolumesNegativeTest-992612787 tempest-VolumesNegativeTest-992612787-project] Returning 404 to user: Instance b626d1e4-c5fd-47aa-be1f-4dbd8c2d50b5 could not be found. {{(pid=117671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:29:59.250194 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-ba1e2bac-54ef-4678-8e05-9e32d9ed4e2d tempest-VolumesNegativeTest-992612787 tempest-VolumesNegativeTest-992612787-project] 10.222.0.30 "GET /compute/v2.1/servers/b626d1e4-c5fd-47aa-be1f-4dbd8c2d50b5" status: 404 len: 111 microversion: 2.1 time: 0.121887 Jun 16 18:29:59.252299 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 95/200] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:29:59 2022] GET /compute/v2.1/servers/b626d1e4-c5fd-47aa-be1f-4dbd8c2d50b5 => generated 111 bytes in 125 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:29:59.309511 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-e50592a4-2e0a-43c8-b4dd-c9654b744205 tempest-DeleteServersTestJSON-823268338 tempest-DeleteServersTestJSON-823268338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee9c06c774f478db33c16b784d6b914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa9111175cad44b2bbc611b7ae36a991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:29:59.349617 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-e50592a4-2e0a-43c8-b4dd-c9654b744205 tempest-DeleteServersTestJSON-823268338 tempest-DeleteServersTestJSON-823268338-project] 10.222.0.30 "GET /compute/v2.1/servers/58790243-9fe3-49d2-b029-40825911ddde" status: 200 len: 1511 microversion: 2.1 time: 0.319304 Jun 16 18:29:59.355476 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 106/201] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:29:59 2022] GET /compute/v2.1/servers/58790243-9fe3-49d2-b029-40825911ddde => generated 1511 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:29:59.575480 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-9609f597-fca3-4844-9215-b1e6e1a5e52d tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:29:59.577004 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-9609f597-fca3-4844-9215-b1e6e1a5e52d tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] [instance: 05981bed-b625-4e9a-b860-6a7ce1288e8d] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:29:59.594167 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-9609f597-fca3-4844-9215-b1e6e1a5e52d tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:59.595439 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-9609f597-fca3-4844-9215-b1e6e1a5e52d tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:59.598147 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-9609f597-fca3-4844-9215-b1e6e1a5e52d tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:29:59.600176 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-9609f597-fca3-4844-9215-b1e6e1a5e52d tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:29:59.965829 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-9609f597-fca3-4844-9215-b1e6e1a5e52d tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512f01cca14b447c8f6c9eebbd828eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70bbccf07e3404cb94ba59201061a6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:29:59.975168 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-9609f597-fca3-4844-9215-b1e6e1a5e52d tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] 10.222.0.30 "GET /compute/v2.1/servers/05981bed-b625-4e9a-b860-6a7ce1288e8d" status: 200 len: 1522 microversion: 2.1 time: 0.414932 Jun 16 18:29:59.976182 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 96/202] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:29:59 2022] GET /compute/v2.1/servers/05981bed-b625-4e9a-b860-6a7ce1288e8d => generated 1522 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:30:00.346856 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [req-43ad4f0c-d2cd-435a-a1ba-0197181d8310 req-f7c538e5-06ca-42cc-8ec7-d40c7b236963 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58790243-9fe3-49d2-b029-40825911ddde", "name": "network-vif-deleted", "tag": "be9e391a-a84f-495c-b209-129c97524123"}]} {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:30:00.375763 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [req-43ad4f0c-d2cd-435a-a1ba-0197181d8310 req-f7c538e5-06ca-42cc-8ec7-d40c7b236963 service nova] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:30:00.377676 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [req-43ad4f0c-d2cd-435a-a1ba-0197181d8310 req-f7c538e5-06ca-42cc-8ec7-d40c7b236963 service nova] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:30:00.382380 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-322d3d3c-8112-469a-b7dc-ce2122f14c61 tempest-DeleteServersTestJSON-823268338 tempest-DeleteServersTestJSON-823268338-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:30:00.386123 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-322d3d3c-8112-469a-b7dc-ce2122f14c61 tempest-DeleteServersTestJSON-823268338 tempest-DeleteServersTestJSON-823268338-project] [instance: 58790243-9fe3-49d2-b029-40825911ddde] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:30:00.401123 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-322d3d3c-8112-469a-b7dc-ce2122f14c61 tempest-DeleteServersTestJSON-823268338 tempest-DeleteServersTestJSON-823268338-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:30:00.402301 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-322d3d3c-8112-469a-b7dc-ce2122f14c61 tempest-DeleteServersTestJSON-823268338 tempest-DeleteServersTestJSON-823268338-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:30:00.403392 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-322d3d3c-8112-469a-b7dc-ce2122f14c61 tempest-DeleteServersTestJSON-823268338 tempest-DeleteServersTestJSON-823268338-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:30:00.403819 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.compute.server_external_events [req-43ad4f0c-d2cd-435a-a1ba-0197181d8310 req-f7c538e5-06ca-42cc-8ec7-d40c7b236963 service nova] Creating event network-vif-deleted:be9e391a-a84f-495c-b209-129c97524123 for instance 58790243-9fe3-49d2-b029-40825911ddde on hv-cinder-81322 Jun 16 18:30:00.404420 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-322d3d3c-8112-469a-b7dc-ce2122f14c61 tempest-DeleteServersTestJSON-823268338 tempest-DeleteServersTestJSON-823268338-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:30:00.418743 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [req-43ad4f0c-d2cd-435a-a1ba-0197181d8310 req-f7c538e5-06ca-42cc-8ec7-d40c7b236963 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087770 Jun 16 18:30:00.423412 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 107/203] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Jun 16 18:30:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:30:00.584497 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-322d3d3c-8112-469a-b7dc-ce2122f14c61 tempest-DeleteServersTestJSON-823268338 tempest-DeleteServersTestJSON-823268338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee9c06c774f478db33c16b784d6b914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa9111175cad44b2bbc611b7ae36a991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:30:00.609421 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-322d3d3c-8112-469a-b7dc-ce2122f14c61 tempest-DeleteServersTestJSON-823268338 tempest-DeleteServersTestJSON-823268338-project] 10.222.0.30 "GET /compute/v2.1/servers/58790243-9fe3-49d2-b029-40825911ddde" status: 200 len: 1511 microversion: 2.1 time: 0.237410 Jun 16 18:30:00.610874 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 97/204] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:30:00 2022] GET /compute/v2.1/servers/58790243-9fe3-49d2-b029-40825911ddde => generated 1511 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:30:01.011928 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-91756684-0514-4385-8ebf-5a171c0c6975 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:30:01.014124 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-91756684-0514-4385-8ebf-5a171c0c6975 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] [instance: 05981bed-b625-4e9a-b860-6a7ce1288e8d] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:30:01.029386 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-91756684-0514-4385-8ebf-5a171c0c6975 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:30:01.031736 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-91756684-0514-4385-8ebf-5a171c0c6975 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:30:01.034282 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-91756684-0514-4385-8ebf-5a171c0c6975 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:30:01.035451 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-91756684-0514-4385-8ebf-5a171c0c6975 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:30:01.581592 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-91756684-0514-4385-8ebf-5a171c0c6975 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512f01cca14b447c8f6c9eebbd828eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70bbccf07e3404cb94ba59201061a6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:30:01.590368 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-91756684-0514-4385-8ebf-5a171c0c6975 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] 10.222.0.30 "GET /compute/v2.1/servers/05981bed-b625-4e9a-b860-6a7ce1288e8d" status: 200 len: 1522 microversion: 2.1 time: 0.589903 Jun 16 18:30:01.591669 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 108/205] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:30:00 2022] GET /compute/v2.1/servers/05981bed-b625-4e9a-b860-6a7ce1288e8d => generated 1522 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:30:01.628766 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-18d05edd-d51f-45c8-8453-b135ddf8a316 tempest-DeleteServersTestJSON-823268338 tempest-DeleteServersTestJSON-823268338-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:30:01.629996 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-18d05edd-d51f-45c8-8453-b135ddf8a316 tempest-DeleteServersTestJSON-823268338 tempest-DeleteServersTestJSON-823268338-project] [instance: 58790243-9fe3-49d2-b029-40825911ddde] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:30:01.640348 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-18d05edd-d51f-45c8-8453-b135ddf8a316 tempest-DeleteServersTestJSON-823268338 tempest-DeleteServersTestJSON-823268338-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:30:01.641272 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-18d05edd-d51f-45c8-8453-b135ddf8a316 tempest-DeleteServersTestJSON-823268338 tempest-DeleteServersTestJSON-823268338-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:30:01.642239 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-18d05edd-d51f-45c8-8453-b135ddf8a316 tempest-DeleteServersTestJSON-823268338 tempest-DeleteServersTestJSON-823268338-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:30:01.643699 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-18d05edd-d51f-45c8-8453-b135ddf8a316 tempest-DeleteServersTestJSON-823268338 tempest-DeleteServersTestJSON-823268338-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:30:01.747918 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-18d05edd-d51f-45c8-8453-b135ddf8a316 tempest-DeleteServersTestJSON-823268338 tempest-DeleteServersTestJSON-823268338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee9c06c774f478db33c16b784d6b914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa9111175cad44b2bbc611b7ae36a991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:30:01.768562 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-18d05edd-d51f-45c8-8453-b135ddf8a316 tempest-DeleteServersTestJSON-823268338 tempest-DeleteServersTestJSON-823268338-project] 10.222.0.30 "GET /compute/v2.1/servers/58790243-9fe3-49d2-b029-40825911ddde" status: 200 len: 1345 microversion: 2.1 time: 0.143557 Jun 16 18:30:01.779859 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 98/206] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:30:01 2022] GET /compute/v2.1/servers/58790243-9fe3-49d2-b029-40825911ddde => generated 1345 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:30:02.626049 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-6db021ba-d9d3-43e9-b02a-069ef3a8fc94 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:30:02.627271 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-6db021ba-d9d3-43e9-b02a-069ef3a8fc94 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] [instance: 05981bed-b625-4e9a-b860-6a7ce1288e8d] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:30:02.640691 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG dbcounter [-] [117670] Writing DB stats nova_api:SELECT=88 {{(pid=117670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:30:02.658842 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-6db021ba-d9d3-43e9-b02a-069ef3a8fc94 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:30:02.659933 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-6db021ba-d9d3-43e9-b02a-069ef3a8fc94 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:30:02.665899 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-6db021ba-d9d3-43e9-b02a-069ef3a8fc94 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:30:02.669198 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-6db021ba-d9d3-43e9-b02a-069ef3a8fc94 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:30:02.798308 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-ed88fef9-7c1d-4bb6-bb22-92d585d833c5 tempest-DeleteServersTestJSON-823268338 tempest-DeleteServersTestJSON-823268338-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:30:02.799503 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-ed88fef9-7c1d-4bb6-bb22-92d585d833c5 tempest-DeleteServersTestJSON-823268338 tempest-DeleteServersTestJSON-823268338-project] [instance: 58790243-9fe3-49d2-b029-40825911ddde] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:30:02.808936 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG dbcounter [-] [117671] Writing DB stats nova_api:SELECT=86,nova_api:UPDATE=2 {{(pid=117671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:30:02.828781 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-ed88fef9-7c1d-4bb6-bb22-92d585d833c5 tempest-DeleteServersTestJSON-823268338 tempest-DeleteServersTestJSON-823268338-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:30:02.832530 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-ed88fef9-7c1d-4bb6-bb22-92d585d833c5 tempest-DeleteServersTestJSON-823268338 tempest-DeleteServersTestJSON-823268338-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:30:02.836810 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-ed88fef9-7c1d-4bb6-bb22-92d585d833c5 tempest-DeleteServersTestJSON-823268338 tempest-DeleteServersTestJSON-823268338-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:30:02.839947 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-ed88fef9-7c1d-4bb6-bb22-92d585d833c5 tempest-DeleteServersTestJSON-823268338 tempest-DeleteServersTestJSON-823268338-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:30:02.892090 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.wsgi [None req-ed88fef9-7c1d-4bb6-bb22-92d585d833c5 tempest-DeleteServersTestJSON-823268338 tempest-DeleteServersTestJSON-823268338-project] HTTP exception thrown: Instance 58790243-9fe3-49d2-b029-40825911ddde could not be found. Jun 16 18:30:02.894072 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-ed88fef9-7c1d-4bb6-bb22-92d585d833c5 tempest-DeleteServersTestJSON-823268338 tempest-DeleteServersTestJSON-823268338-project] Request method failure captured: Jun 16 18:30:02.894072 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: request: GET /compute/v2.1/servers/58790243-9fe3-49d2-b029-40825911ddde HTTP/1.1 Jun 16 18:30:02.894072 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: Accept: application/json Jun 16 18:30:02.894072 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: Accept-Encoding: identity Jun 16 18:30:02.894072 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: Connection: close Jun 16 18:30:02.894072 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: Content-Length: 0 Jun 16 18:30:02.894072 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: Content-Type: application/json Jun 16 18:30:02.894072 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: Host: 10.222.0.30 Jun 16 18:30:02.894072 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: Openstack-System-Scope: None Jun 16 18:30:02.894072 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: User-Agent: python-urllib3/1.26.9 Jun 16 18:30:02.894072 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Auth-Token: gAAAAABiq3ZcaMwF27R0FrXhh6tOhYlvJVbZSKTsPjR5upv5PE4Ac_qWvSat-ka7g9TOzojaHhFL92u3PmZmHE7xzC7PPcTtYbrRIEHvsaml2TOxP6dJTDChrJpS5h5bTufxfvs-PlUucDvU42WzOHuNraYsvinu9zW7IzDcRXCTmf-3EAU4gag Jun 16 18:30:02.894072 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Domain-Id: None Jun 16 18:30:02.894072 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Domain-Name: None Jun 16 18:30:02.894072 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Identity-Status: Confirmed Jun 16 18:30:02.894072 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Is-Admin-Project: True Jun 16 18:30:02.894072 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Project-Domain-Id: default Jun 16 18:30:02.894072 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Project-Domain-Name: Default Jun 16 18:30:02.894072 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Project-Id: aa9111175cad44b2bbc611b7ae36a991 Jun 16 18:30:02.894072 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Project-Name: tempest-DeleteServersTestJSON-823268338 Jun 16 18:30:02.894072 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Role: reader,member Jun 16 18:30:02.894072 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Roles: reader,member Jun 16 18:30:02.895592 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/aa9111175cad44b2bbc611b7ae36a991"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/aa9111175cad44b2bbc611b7ae36a991"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_aa9111175cad44b2bbc611b7ae36a991", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/aa9111175cad44b2bbc611b7ae36a991"}]}] Jun 16 18:30:02.895592 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Tenant: tempest-DeleteServersTestJSON-823268338 Jun 16 18:30:02.895592 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Tenant-Id: aa9111175cad44b2bbc611b7ae36a991 Jun 16 18:30:02.895592 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Tenant-Name: tempest-DeleteServersTestJSON-823268338 Jun 16 18:30:02.895592 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-User: tempest-DeleteServersTestJSON-823268338-project Jun 16 18:30:02.895592 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-User-Domain-Id: default Jun 16 18:30:02.895592 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-User-Domain-Name: Default Jun 16 18:30:02.895592 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-User-Id: 7ee9c06c774f478db33c16b784d6b914 Jun 16 18:30:02.895592 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-User-Name: tempest-DeleteServersTestJSON-823268338-project Jun 16 18:30:02.895592 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: method: > Jun 16 18:30:02.895592 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: exception: Instance 58790243-9fe3-49d2-b029-40825911ddde could not be found. Jun 16 18:30:02.895592 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: action_args: {'id': '58790243-9fe3-49d2-b029-40825911ddde'} Jun 16 18:30:02.896639 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:30:02.896639 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:30:02.896639 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 18:30:02.896639 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 18:30:02.896639 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 18:30:02.896639 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 18:30:02.896639 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 18:30:02.896639 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 18:30:02.896639 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 18:30:02.896639 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 18:30:02.896639 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 58790243-9fe3-49d2-b029-40825911ddde could not be found. Jun 16 18:30:02.896639 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Jun 16 18:30:02.896639 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:30:02.896639 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Jun 16 18:30:02.896639 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:30:02.896639 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:30:02.896639 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:30:02.896639 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:30:02.896639 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:30:02.896639 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:30:02.897988 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:30:02.897988 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 18:30:02.897988 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 18:30:02.897988 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 18:30:02.897988 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 18:30:02.897988 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 18:30:02.897988 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:30:02.897988 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 58790243-9fe3-49d2-b029-40825911ddde could not be found. Jun 16 18:30:02.897988 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Jun 16 18:30:02.897988 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:30:02.897988 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Jun 16 18:30:02.897988 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:30:02.897988 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:30:02.897988 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:30:02.897988 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:30:02.897988 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:30:02.897988 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 58790243-9fe3-49d2-b029-40825911ddde could not be found. Jun 16 18:30:02.897988 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Jun 16 18:30:02.901208 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-ed88fef9-7c1d-4bb6-bb22-92d585d833c5 tempest-DeleteServersTestJSON-823268338 tempest-DeleteServersTestJSON-823268338-project] Returning 404 to user: Instance 58790243-9fe3-49d2-b029-40825911ddde could not be found. {{(pid=117671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:30:02.902517 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-ed88fef9-7c1d-4bb6-bb22-92d585d833c5 tempest-DeleteServersTestJSON-823268338 tempest-DeleteServersTestJSON-823268338-project] 10.222.0.30 "GET /compute/v2.1/servers/58790243-9fe3-49d2-b029-40825911ddde" status: 404 len: 111 microversion: 2.1 time: 0.112914 Jun 16 18:30:02.903644 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 99/207] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:30:02 2022] GET /compute/v2.1/servers/58790243-9fe3-49d2-b029-40825911ddde => generated 111 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:30:03.039693 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-6db021ba-d9d3-43e9-b02a-069ef3a8fc94 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512f01cca14b447c8f6c9eebbd828eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70bbccf07e3404cb94ba59201061a6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:30:03.054255 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-6db021ba-d9d3-43e9-b02a-069ef3a8fc94 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] 10.222.0.30 "GET /compute/v2.1/servers/05981bed-b625-4e9a-b860-6a7ce1288e8d" status: 200 len: 1522 microversion: 2.1 time: 0.437546 Jun 16 18:30:03.067454 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 109/208] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:30:02 2022] GET /compute/v2.1/servers/05981bed-b625-4e9a-b860-6a7ce1288e8d => generated 1522 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:30:03.171598 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-eb14c5e1-48bc-4f39-b0a0-f08e6f820ef1 tempest-DeleteServersTestJSON-823268338 tempest-DeleteServersTestJSON-823268338-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:30:03.173178 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-eb14c5e1-48bc-4f39-b0a0-f08e6f820ef1 tempest-DeleteServersTestJSON-823268338 tempest-DeleteServersTestJSON-823268338-project] [instance: 58790243-9fe3-49d2-b029-40825911ddde] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:30:03.182288 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-eb14c5e1-48bc-4f39-b0a0-f08e6f820ef1 tempest-DeleteServersTestJSON-823268338 tempest-DeleteServersTestJSON-823268338-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:30:03.183081 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-eb14c5e1-48bc-4f39-b0a0-f08e6f820ef1 tempest-DeleteServersTestJSON-823268338 tempest-DeleteServersTestJSON-823268338-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:30:03.184245 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-eb14c5e1-48bc-4f39-b0a0-f08e6f820ef1 tempest-DeleteServersTestJSON-823268338 tempest-DeleteServersTestJSON-823268338-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:30:03.184430 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-eb14c5e1-48bc-4f39-b0a0-f08e6f820ef1 tempest-DeleteServersTestJSON-823268338 tempest-DeleteServersTestJSON-823268338-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:30:03.207674 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.wsgi [None req-eb14c5e1-48bc-4f39-b0a0-f08e6f820ef1 tempest-DeleteServersTestJSON-823268338 tempest-DeleteServersTestJSON-823268338-project] HTTP exception thrown: Instance 58790243-9fe3-49d2-b029-40825911ddde could not be found. Jun 16 18:30:03.209668 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-eb14c5e1-48bc-4f39-b0a0-f08e6f820ef1 tempest-DeleteServersTestJSON-823268338 tempest-DeleteServersTestJSON-823268338-project] Request method failure captured: Jun 16 18:30:03.209668 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: request: GET /compute/v2.1/servers/58790243-9fe3-49d2-b029-40825911ddde/os-volume_attachments HTTP/1.1 Jun 16 18:30:03.209668 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: Accept: application/json Jun 16 18:30:03.209668 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: Accept-Encoding: identity Jun 16 18:30:03.209668 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: Connection: close Jun 16 18:30:03.209668 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: Content-Length: 0 Jun 16 18:30:03.209668 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: Content-Type: application/json Jun 16 18:30:03.209668 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: Host: 10.222.0.30 Jun 16 18:30:03.209668 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: Openstack-System-Scope: None Jun 16 18:30:03.209668 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: User-Agent: python-urllib3/1.26.9 Jun 16 18:30:03.209668 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Auth-Token: gAAAAABiq3ZcaMwF27R0FrXhh6tOhYlvJVbZSKTsPjR5upv5PE4Ac_qWvSat-ka7g9TOzojaHhFL92u3PmZmHE7xzC7PPcTtYbrRIEHvsaml2TOxP6dJTDChrJpS5h5bTufxfvs-PlUucDvU42WzOHuNraYsvinu9zW7IzDcRXCTmf-3EAU4gag Jun 16 18:30:03.209668 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Domain-Id: None Jun 16 18:30:03.209668 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Domain-Name: None Jun 16 18:30:03.209668 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Identity-Status: Confirmed Jun 16 18:30:03.209668 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Is-Admin-Project: True Jun 16 18:30:03.209668 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Project-Domain-Id: default Jun 16 18:30:03.209668 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Project-Domain-Name: Default Jun 16 18:30:03.209668 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Project-Id: aa9111175cad44b2bbc611b7ae36a991 Jun 16 18:30:03.209668 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Project-Name: tempest-DeleteServersTestJSON-823268338 Jun 16 18:30:03.209668 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Role: reader,member Jun 16 18:30:03.209668 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Roles: reader,member Jun 16 18:30:03.211142 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/aa9111175cad44b2bbc611b7ae36a991"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/aa9111175cad44b2bbc611b7ae36a991"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_aa9111175cad44b2bbc611b7ae36a991", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/aa9111175cad44b2bbc611b7ae36a991"}]}] Jun 16 18:30:03.211142 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Tenant: tempest-DeleteServersTestJSON-823268338 Jun 16 18:30:03.211142 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Tenant-Id: aa9111175cad44b2bbc611b7ae36a991 Jun 16 18:30:03.211142 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Tenant-Name: tempest-DeleteServersTestJSON-823268338 Jun 16 18:30:03.211142 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-User: tempest-DeleteServersTestJSON-823268338-project Jun 16 18:30:03.211142 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-User-Domain-Id: default Jun 16 18:30:03.211142 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-User-Domain-Name: Default Jun 16 18:30:03.211142 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-User-Id: 7ee9c06c774f478db33c16b784d6b914 Jun 16 18:30:03.211142 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-User-Name: tempest-DeleteServersTestJSON-823268338-project Jun 16 18:30:03.211142 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: method: > Jun 16 18:30:03.211142 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: exception: Instance 58790243-9fe3-49d2-b029-40825911ddde could not be found. Jun 16 18:30:03.211142 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: action_args: {'server_id': '58790243-9fe3-49d2-b029-40825911ddde'} Jun 16 18:30:03.211897 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:30:03.211897 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:30:03.211897 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 18:30:03.211897 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 18:30:03.211897 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 18:30:03.211897 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 18:30:03.211897 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 18:30:03.211897 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 18:30:03.211897 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 18:30:03.211897 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 18:30:03.211897 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 58790243-9fe3-49d2-b029-40825911ddde could not be found. Jun 16 18:30:03.211897 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Jun 16 18:30:03.211897 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:30:03.211897 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Jun 16 18:30:03.211897 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:30:03.211897 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:30:03.211897 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:30:03.211897 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:30:03.211897 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:30:03.211897 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:30:03.214048 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:30:03.214048 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 16 18:30:03.214048 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 18:30:03.214048 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 16 18:30:03.214048 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 18:30:03.214048 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jun 16 18:30:03.214048 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jun 16 18:30:03.214048 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 18:30:03.214048 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:30:03.214048 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 58790243-9fe3-49d2-b029-40825911ddde could not be found. Jun 16 18:30:03.214048 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Jun 16 18:30:03.214048 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:30:03.214048 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Jun 16 18:30:03.214048 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:30:03.214048 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:30:03.214048 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:30:03.214048 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:30:03.214048 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:30:03.214048 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 58790243-9fe3-49d2-b029-40825911ddde could not be found. Jun 16 18:30:03.214048 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Jun 16 18:30:03.216851 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-eb14c5e1-48bc-4f39-b0a0-f08e6f820ef1 tempest-DeleteServersTestJSON-823268338 tempest-DeleteServersTestJSON-823268338-project] Returning 404 to user: Instance 58790243-9fe3-49d2-b029-40825911ddde could not be found. {{(pid=117671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:30:03.217950 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-eb14c5e1-48bc-4f39-b0a0-f08e6f820ef1 tempest-DeleteServersTestJSON-823268338 tempest-DeleteServersTestJSON-823268338-project] 10.222.0.30 "GET /compute/v2.1/servers/58790243-9fe3-49d2-b029-40825911ddde/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.055075 Jun 16 18:30:03.219405 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 100/209] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Jun 16 18:30:03 2022] GET /compute/v2.1/servers/58790243-9fe3-49d2-b029-40825911ddde/os-volume_attachments => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:30:04.082054 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-b99243aa-5ee2-49c1-9dc2-f6f2bdf47d72 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:30:04.082664 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-b99243aa-5ee2-49c1-9dc2-f6f2bdf47d72 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] [instance: 05981bed-b625-4e9a-b860-6a7ce1288e8d] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:30:04.094439 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-b99243aa-5ee2-49c1-9dc2-f6f2bdf47d72 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:30:04.094887 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-b99243aa-5ee2-49c1-9dc2-f6f2bdf47d72 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:30:04.095697 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-b99243aa-5ee2-49c1-9dc2-f6f2bdf47d72 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:30:04.096184 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-b99243aa-5ee2-49c1-9dc2-f6f2bdf47d72 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:30:04.390328 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-b99243aa-5ee2-49c1-9dc2-f6f2bdf47d72 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512f01cca14b447c8f6c9eebbd828eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70bbccf07e3404cb94ba59201061a6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:30:04.399334 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-b99243aa-5ee2-49c1-9dc2-f6f2bdf47d72 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] 10.222.0.30 "GET /compute/v2.1/servers/05981bed-b625-4e9a-b860-6a7ce1288e8d" status: 200 len: 1522 microversion: 2.1 time: 0.321870 Jun 16 18:30:04.412969 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 110/210] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:30:04 2022] GET /compute/v2.1/servers/05981bed-b625-4e9a-b860-6a7ce1288e8d => generated 1522 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:30:05.030667 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-da75d7cf-e81c-4a78-8196-7471c0989019 tempest-DeleteServersTestJSON-823268338 tempest-DeleteServersTestJSON-823268338-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:30:05.031931 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-da75d7cf-e81c-4a78-8196-7471c0989019 tempest-DeleteServersTestJSON-823268338 tempest-DeleteServersTestJSON-823268338-project] [instance: 58790243-9fe3-49d2-b029-40825911ddde] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:30:05.045652 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-da75d7cf-e81c-4a78-8196-7471c0989019 tempest-DeleteServersTestJSON-823268338 tempest-DeleteServersTestJSON-823268338-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:30:05.045652 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-da75d7cf-e81c-4a78-8196-7471c0989019 tempest-DeleteServersTestJSON-823268338 tempest-DeleteServersTestJSON-823268338-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:30:05.046369 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-da75d7cf-e81c-4a78-8196-7471c0989019 tempest-DeleteServersTestJSON-823268338 tempest-DeleteServersTestJSON-823268338-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:30:05.046619 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-da75d7cf-e81c-4a78-8196-7471c0989019 tempest-DeleteServersTestJSON-823268338 tempest-DeleteServersTestJSON-823268338-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:30:05.078159 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.wsgi [None req-da75d7cf-e81c-4a78-8196-7471c0989019 tempest-DeleteServersTestJSON-823268338 tempest-DeleteServersTestJSON-823268338-project] HTTP exception thrown: Instance 58790243-9fe3-49d2-b029-40825911ddde could not be found. Jun 16 18:30:05.081842 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-da75d7cf-e81c-4a78-8196-7471c0989019 tempest-DeleteServersTestJSON-823268338 tempest-DeleteServersTestJSON-823268338-project] Request method failure captured: Jun 16 18:30:05.081842 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: request: DELETE /compute/v2.1/servers/58790243-9fe3-49d2-b029-40825911ddde HTTP/1.1 Jun 16 18:30:05.081842 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: Accept: application/json Jun 16 18:30:05.081842 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: Accept-Encoding: identity Jun 16 18:30:05.081842 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: Connection: close Jun 16 18:30:05.081842 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: Content-Length: 0 Jun 16 18:30:05.081842 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: Content-Type: application/json Jun 16 18:30:05.081842 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: Host: 10.222.0.30 Jun 16 18:30:05.081842 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: Openstack-System-Scope: None Jun 16 18:30:05.081842 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: User-Agent: python-urllib3/1.26.9 Jun 16 18:30:05.081842 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Auth-Token: gAAAAABiq3ZcaMwF27R0FrXhh6tOhYlvJVbZSKTsPjR5upv5PE4Ac_qWvSat-ka7g9TOzojaHhFL92u3PmZmHE7xzC7PPcTtYbrRIEHvsaml2TOxP6dJTDChrJpS5h5bTufxfvs-PlUucDvU42WzOHuNraYsvinu9zW7IzDcRXCTmf-3EAU4gag Jun 16 18:30:05.081842 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Domain-Id: None Jun 16 18:30:05.081842 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Domain-Name: None Jun 16 18:30:05.081842 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Identity-Status: Confirmed Jun 16 18:30:05.081842 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Is-Admin-Project: True Jun 16 18:30:05.081842 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Project-Domain-Id: default Jun 16 18:30:05.081842 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Project-Domain-Name: Default Jun 16 18:30:05.081842 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Project-Id: aa9111175cad44b2bbc611b7ae36a991 Jun 16 18:30:05.081842 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Project-Name: tempest-DeleteServersTestJSON-823268338 Jun 16 18:30:05.081842 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Role: reader,member Jun 16 18:30:05.081842 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Roles: reader,member Jun 16 18:30:05.083376 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/aa9111175cad44b2bbc611b7ae36a991"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/aa9111175cad44b2bbc611b7ae36a991"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_aa9111175cad44b2bbc611b7ae36a991", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/aa9111175cad44b2bbc611b7ae36a991"}]}] Jun 16 18:30:05.083376 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Tenant: tempest-DeleteServersTestJSON-823268338 Jun 16 18:30:05.083376 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Tenant-Id: aa9111175cad44b2bbc611b7ae36a991 Jun 16 18:30:05.083376 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Tenant-Name: tempest-DeleteServersTestJSON-823268338 Jun 16 18:30:05.083376 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-User: tempest-DeleteServersTestJSON-823268338-project Jun 16 18:30:05.083376 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-User-Domain-Id: default Jun 16 18:30:05.083376 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-User-Domain-Name: Default Jun 16 18:30:05.083376 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-User-Id: 7ee9c06c774f478db33c16b784d6b914 Jun 16 18:30:05.083376 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-User-Name: tempest-DeleteServersTestJSON-823268338-project Jun 16 18:30:05.083376 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: method: > Jun 16 18:30:05.083376 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: exception: Instance 58790243-9fe3-49d2-b029-40825911ddde could not be found. Jun 16 18:30:05.083376 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: action_args: {'id': '58790243-9fe3-49d2-b029-40825911ddde'} Jun 16 18:30:05.084181 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:30:05.084181 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:30:05.084181 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 18:30:05.084181 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 18:30:05.084181 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 18:30:05.084181 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 18:30:05.084181 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 18:30:05.084181 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 18:30:05.084181 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 18:30:05.084181 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 18:30:05.084181 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 58790243-9fe3-49d2-b029-40825911ddde could not be found. Jun 16 18:30:05.084181 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Jun 16 18:30:05.084181 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:30:05.084181 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Jun 16 18:30:05.084181 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:30:05.084181 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:30:05.084181 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:30:05.084181 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:30:05.084181 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:30:05.084181 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:30:05.085282 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:30:05.085282 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 16 18:30:05.085282 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 16 18:30:05.085282 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 16 18:30:05.085282 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 16 18:30:05.085282 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 18:30:05.085282 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 18:30:05.085282 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 18:30:05.085282 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:30:05.085282 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 58790243-9fe3-49d2-b029-40825911ddde could not be found. Jun 16 18:30:05.085282 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Jun 16 18:30:05.085282 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:30:05.085282 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Jun 16 18:30:05.085282 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:30:05.085282 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:30:05.085282 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:30:05.085282 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:30:05.085282 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:30:05.085282 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 58790243-9fe3-49d2-b029-40825911ddde could not be found. Jun 16 18:30:05.085282 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Jun 16 18:30:05.087457 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-da75d7cf-e81c-4a78-8196-7471c0989019 tempest-DeleteServersTestJSON-823268338 tempest-DeleteServersTestJSON-823268338-project] Returning 404 to user: Instance 58790243-9fe3-49d2-b029-40825911ddde could not be found. {{(pid=117671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:30:05.089404 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-da75d7cf-e81c-4a78-8196-7471c0989019 tempest-DeleteServersTestJSON-823268338 tempest-DeleteServersTestJSON-823268338-project] 10.222.0.30 "DELETE /compute/v2.1/servers/58790243-9fe3-49d2-b029-40825911ddde" status: 404 len: 111 microversion: 2.1 time: 0.068372 Jun 16 18:30:05.090202 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 101/211] 10.222.0.30 () {58 vars in 1238 bytes} [Thu Jun 16 18:30:05 2022] DELETE /compute/v2.1/servers/58790243-9fe3-49d2-b029-40825911ddde => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 16 18:30:05.110845 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-a3740042-e8f1-4b11-adc7-d306cff48b26 tempest-DeleteServersTestJSON-823268338 tempest-DeleteServersTestJSON-823268338-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:30:05.111993 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-a3740042-e8f1-4b11-adc7-d306cff48b26 tempest-DeleteServersTestJSON-823268338 tempest-DeleteServersTestJSON-823268338-project] [instance: 58790243-9fe3-49d2-b029-40825911ddde] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:30:05.122973 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-a3740042-e8f1-4b11-adc7-d306cff48b26 tempest-DeleteServersTestJSON-823268338 tempest-DeleteServersTestJSON-823268338-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:30:05.123727 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-a3740042-e8f1-4b11-adc7-d306cff48b26 tempest-DeleteServersTestJSON-823268338 tempest-DeleteServersTestJSON-823268338-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:30:05.125092 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-a3740042-e8f1-4b11-adc7-d306cff48b26 tempest-DeleteServersTestJSON-823268338 tempest-DeleteServersTestJSON-823268338-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:30:05.126086 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-a3740042-e8f1-4b11-adc7-d306cff48b26 tempest-DeleteServersTestJSON-823268338 tempest-DeleteServersTestJSON-823268338-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:30:05.158855 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.wsgi [None req-a3740042-e8f1-4b11-adc7-d306cff48b26 tempest-DeleteServersTestJSON-823268338 tempest-DeleteServersTestJSON-823268338-project] HTTP exception thrown: Instance 58790243-9fe3-49d2-b029-40825911ddde could not be found. Jun 16 18:30:05.170516 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-a3740042-e8f1-4b11-adc7-d306cff48b26 tempest-DeleteServersTestJSON-823268338 tempest-DeleteServersTestJSON-823268338-project] Request method failure captured: Jun 16 18:30:05.170516 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: request: GET /compute/v2.1/servers/58790243-9fe3-49d2-b029-40825911ddde HTTP/1.1 Jun 16 18:30:05.170516 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: Accept: application/json Jun 16 18:30:05.170516 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: Accept-Encoding: identity Jun 16 18:30:05.170516 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: Connection: close Jun 16 18:30:05.170516 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: Content-Length: 0 Jun 16 18:30:05.170516 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: Content-Type: application/json Jun 16 18:30:05.170516 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: Host: 10.222.0.30 Jun 16 18:30:05.170516 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: Openstack-System-Scope: None Jun 16 18:30:05.170516 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: User-Agent: python-urllib3/1.26.9 Jun 16 18:30:05.170516 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Auth-Token: gAAAAABiq3ZcaMwF27R0FrXhh6tOhYlvJVbZSKTsPjR5upv5PE4Ac_qWvSat-ka7g9TOzojaHhFL92u3PmZmHE7xzC7PPcTtYbrRIEHvsaml2TOxP6dJTDChrJpS5h5bTufxfvs-PlUucDvU42WzOHuNraYsvinu9zW7IzDcRXCTmf-3EAU4gag Jun 16 18:30:05.170516 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Domain-Id: None Jun 16 18:30:05.170516 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Domain-Name: None Jun 16 18:30:05.170516 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Identity-Status: Confirmed Jun 16 18:30:05.170516 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Is-Admin-Project: True Jun 16 18:30:05.170516 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Project-Domain-Id: default Jun 16 18:30:05.170516 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Project-Domain-Name: Default Jun 16 18:30:05.170516 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Project-Id: aa9111175cad44b2bbc611b7ae36a991 Jun 16 18:30:05.170516 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Project-Name: tempest-DeleteServersTestJSON-823268338 Jun 16 18:30:05.170516 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Role: reader,member Jun 16 18:30:05.170516 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Roles: reader,member Jun 16 18:30:05.171823 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/aa9111175cad44b2bbc611b7ae36a991"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/aa9111175cad44b2bbc611b7ae36a991"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_aa9111175cad44b2bbc611b7ae36a991", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/aa9111175cad44b2bbc611b7ae36a991"}]}] Jun 16 18:30:05.171823 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Tenant: tempest-DeleteServersTestJSON-823268338 Jun 16 18:30:05.171823 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Tenant-Id: aa9111175cad44b2bbc611b7ae36a991 Jun 16 18:30:05.171823 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Tenant-Name: tempest-DeleteServersTestJSON-823268338 Jun 16 18:30:05.171823 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-User: tempest-DeleteServersTestJSON-823268338-project Jun 16 18:30:05.171823 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-User-Domain-Id: default Jun 16 18:30:05.171823 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-User-Domain-Name: Default Jun 16 18:30:05.171823 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-User-Id: 7ee9c06c774f478db33c16b784d6b914 Jun 16 18:30:05.171823 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-User-Name: tempest-DeleteServersTestJSON-823268338-project Jun 16 18:30:05.171823 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: method: > Jun 16 18:30:05.171823 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: exception: Instance 58790243-9fe3-49d2-b029-40825911ddde could not be found. Jun 16 18:30:05.171823 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: action_args: {'id': '58790243-9fe3-49d2-b029-40825911ddde'} Jun 16 18:30:05.172881 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:30:05.172881 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:30:05.172881 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 18:30:05.172881 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 18:30:05.172881 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 18:30:05.172881 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 18:30:05.172881 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 18:30:05.172881 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 18:30:05.172881 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 18:30:05.172881 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 18:30:05.172881 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 58790243-9fe3-49d2-b029-40825911ddde could not be found. Jun 16 18:30:05.172881 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi Jun 16 18:30:05.172881 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:30:05.172881 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi Jun 16 18:30:05.172881 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:30:05.172881 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:30:05.172881 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:30:05.172881 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:30:05.172881 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:30:05.172881 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:30:05.174886 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:30:05.174886 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 18:30:05.174886 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 18:30:05.174886 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 18:30:05.174886 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 18:30:05.174886 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 18:30:05.174886 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:30:05.174886 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 58790243-9fe3-49d2-b029-40825911ddde could not be found. Jun 16 18:30:05.174886 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi Jun 16 18:30:05.174886 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:30:05.174886 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi Jun 16 18:30:05.174886 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:30:05.174886 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:30:05.174886 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:30:05.174886 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:30:05.174886 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:30:05.174886 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 58790243-9fe3-49d2-b029-40825911ddde could not be found. Jun 16 18:30:05.174886 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi Jun 16 18:30:05.176895 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-a3740042-e8f1-4b11-adc7-d306cff48b26 tempest-DeleteServersTestJSON-823268338 tempest-DeleteServersTestJSON-823268338-project] Returning 404 to user: Instance 58790243-9fe3-49d2-b029-40825911ddde could not be found. {{(pid=117670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:30:05.176895 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-a3740042-e8f1-4b11-adc7-d306cff48b26 tempest-DeleteServersTestJSON-823268338 tempest-DeleteServersTestJSON-823268338-project] 10.222.0.30 "GET /compute/v2.1/servers/58790243-9fe3-49d2-b029-40825911ddde" status: 404 len: 111 microversion: 2.1 time: 0.077668 Jun 16 18:30:05.176895 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 111/212] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:30:05 2022] GET /compute/v2.1/servers/58790243-9fe3-49d2-b029-40825911ddde => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:30:05.440424 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-fa24b535-7866-460d-a5fe-c3cf505454ab tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:30:05.441581 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-fa24b535-7866-460d-a5fe-c3cf505454ab tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] [instance: 05981bed-b625-4e9a-b860-6a7ce1288e8d] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:30:05.458332 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-fa24b535-7866-460d-a5fe-c3cf505454ab tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:30:05.459221 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-fa24b535-7866-460d-a5fe-c3cf505454ab tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:30:05.460919 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-fa24b535-7866-460d-a5fe-c3cf505454ab tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:30:05.461806 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-fa24b535-7866-460d-a5fe-c3cf505454ab tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:30:05.472600 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG dbcounter [-] [117671] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:30:05.872648 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-fa24b535-7866-460d-a5fe-c3cf505454ab tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512f01cca14b447c8f6c9eebbd828eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70bbccf07e3404cb94ba59201061a6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:30:05.893495 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-fa24b535-7866-460d-a5fe-c3cf505454ab tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] 10.222.0.30 "GET /compute/v2.1/servers/05981bed-b625-4e9a-b860-6a7ce1288e8d" status: 200 len: 1522 microversion: 2.1 time: 0.473751 Jun 16 18:30:05.894974 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 102/213] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:30:05 2022] GET /compute/v2.1/servers/05981bed-b625-4e9a-b860-6a7ce1288e8d => generated 1522 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:30:06.917481 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-5b2297f4-9446-4ad7-b0e1-e4c8f7646bdd tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:30:06.932767 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-5b2297f4-9446-4ad7-b0e1-e4c8f7646bdd tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] [instance: 05981bed-b625-4e9a-b860-6a7ce1288e8d] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:30:06.946908 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-5b2297f4-9446-4ad7-b0e1-e4c8f7646bdd tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:30:06.946908 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-5b2297f4-9446-4ad7-b0e1-e4c8f7646bdd tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:30:06.948672 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-5b2297f4-9446-4ad7-b0e1-e4c8f7646bdd tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:30:06.948672 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-5b2297f4-9446-4ad7-b0e1-e4c8f7646bdd tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:30:07.240578 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-5b2297f4-9446-4ad7-b0e1-e4c8f7646bdd tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512f01cca14b447c8f6c9eebbd828eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70bbccf07e3404cb94ba59201061a6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:30:07.250784 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-5b2297f4-9446-4ad7-b0e1-e4c8f7646bdd tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] 10.222.0.30 "GET /compute/v2.1/servers/05981bed-b625-4e9a-b860-6a7ce1288e8d" status: 200 len: 1522 microversion: 2.1 time: 0.337760 Jun 16 18:30:07.251926 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 112/214] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:30:06 2022] GET /compute/v2.1/servers/05981bed-b625-4e9a-b860-6a7ce1288e8d => generated 1522 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:30:08.286336 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-5fc17455-1b13-4197-9b02-39cc3ed04f67 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:30:08.289761 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-5fc17455-1b13-4197-9b02-39cc3ed04f67 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] [instance: 05981bed-b625-4e9a-b860-6a7ce1288e8d] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:30:08.353697 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-5fc17455-1b13-4197-9b02-39cc3ed04f67 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:30:08.354233 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-5fc17455-1b13-4197-9b02-39cc3ed04f67 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:30:08.357469 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-5fc17455-1b13-4197-9b02-39cc3ed04f67 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:30:08.357920 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-5fc17455-1b13-4197-9b02-39cc3ed04f67 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:30:08.832998 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-5fc17455-1b13-4197-9b02-39cc3ed04f67 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512f01cca14b447c8f6c9eebbd828eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70bbccf07e3404cb94ba59201061a6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:30:08.866107 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-5fc17455-1b13-4197-9b02-39cc3ed04f67 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] 10.222.0.30 "GET /compute/v2.1/servers/05981bed-b625-4e9a-b860-6a7ce1288e8d" status: 200 len: 1522 microversion: 2.1 time: 0.584891 Jun 16 18:30:08.880210 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 103/215] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:30:08 2022] GET /compute/v2.1/servers/05981bed-b625-4e9a-b860-6a7ce1288e8d => generated 1522 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:30:09.895557 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-513a219d-0e5c-484d-a43d-8d83fd666c8d tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:30:09.896855 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-513a219d-0e5c-484d-a43d-8d83fd666c8d tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] [instance: 05981bed-b625-4e9a-b860-6a7ce1288e8d] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:30:09.908796 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-513a219d-0e5c-484d-a43d-8d83fd666c8d tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:30:09.912798 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-513a219d-0e5c-484d-a43d-8d83fd666c8d tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:30:09.914500 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-513a219d-0e5c-484d-a43d-8d83fd666c8d tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:30:09.916897 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-513a219d-0e5c-484d-a43d-8d83fd666c8d tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:30:10.504765 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-513a219d-0e5c-484d-a43d-8d83fd666c8d tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512f01cca14b447c8f6c9eebbd828eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70bbccf07e3404cb94ba59201061a6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:30:10.518673 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-513a219d-0e5c-484d-a43d-8d83fd666c8d tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] 10.222.0.30 "GET /compute/v2.1/servers/05981bed-b625-4e9a-b860-6a7ce1288e8d" status: 200 len: 1522 microversion: 2.1 time: 0.627400 Jun 16 18:30:10.534006 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 113/216] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:30:09 2022] GET /compute/v2.1/servers/05981bed-b625-4e9a-b860-6a7ce1288e8d => generated 1522 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:30:11.539277 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-4827df8d-53b7-4afd-aed4-d9cc1371e3c5 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:30:11.540335 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-4827df8d-53b7-4afd-aed4-d9cc1371e3c5 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] [instance: 05981bed-b625-4e9a-b860-6a7ce1288e8d] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:30:11.563473 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-4827df8d-53b7-4afd-aed4-d9cc1371e3c5 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:30:11.563946 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-4827df8d-53b7-4afd-aed4-d9cc1371e3c5 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:30:11.564790 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-4827df8d-53b7-4afd-aed4-d9cc1371e3c5 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:30:11.565239 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-4827df8d-53b7-4afd-aed4-d9cc1371e3c5 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:30:12.005999 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-4827df8d-53b7-4afd-aed4-d9cc1371e3c5 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512f01cca14b447c8f6c9eebbd828eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70bbccf07e3404cb94ba59201061a6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:30:12.028363 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-4827df8d-53b7-4afd-aed4-d9cc1371e3c5 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] 10.222.0.30 "GET /compute/v2.1/servers/05981bed-b625-4e9a-b860-6a7ce1288e8d" status: 200 len: 1522 microversion: 2.1 time: 0.494075 Jun 16 18:30:12.046876 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 104/217] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:30:11 2022] GET /compute/v2.1/servers/05981bed-b625-4e9a-b860-6a7ce1288e8d => generated 1522 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:30:13.074672 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-4dda537c-6005-4b20-bda1-245a26276228 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:30:13.079612 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-4dda537c-6005-4b20-bda1-245a26276228 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] [instance: 05981bed-b625-4e9a-b860-6a7ce1288e8d] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:30:13.097306 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-4dda537c-6005-4b20-bda1-245a26276228 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:30:13.098019 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-4dda537c-6005-4b20-bda1-245a26276228 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:30:13.099469 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-4dda537c-6005-4b20-bda1-245a26276228 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:30:13.100807 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-4dda537c-6005-4b20-bda1-245a26276228 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:30:13.645058 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-4dda537c-6005-4b20-bda1-245a26276228 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512f01cca14b447c8f6c9eebbd828eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70bbccf07e3404cb94ba59201061a6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:30:13.673066 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-4dda537c-6005-4b20-bda1-245a26276228 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] 10.222.0.30 "GET /compute/v2.1/servers/05981bed-b625-4e9a-b860-6a7ce1288e8d" status: 200 len: 1522 microversion: 2.1 time: 0.615009 Jun 16 18:30:13.694810 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 114/218] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:30:13 2022] GET /compute/v2.1/servers/05981bed-b625-4e9a-b860-6a7ce1288e8d => generated 1522 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:30:14.706102 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-6f5f3946-46fb-4b01-8fc7-cce0cfe913fd tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:30:14.707230 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-6f5f3946-46fb-4b01-8fc7-cce0cfe913fd tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] [instance: 05981bed-b625-4e9a-b860-6a7ce1288e8d] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:30:14.730872 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-6f5f3946-46fb-4b01-8fc7-cce0cfe913fd tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:30:14.731795 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-6f5f3946-46fb-4b01-8fc7-cce0cfe913fd tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:30:14.733308 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-6f5f3946-46fb-4b01-8fc7-cce0cfe913fd tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:30:14.734555 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-6f5f3946-46fb-4b01-8fc7-cce0cfe913fd tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:30:15.227484 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-6f5f3946-46fb-4b01-8fc7-cce0cfe913fd tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512f01cca14b447c8f6c9eebbd828eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70bbccf07e3404cb94ba59201061a6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:30:15.251207 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-6f5f3946-46fb-4b01-8fc7-cce0cfe913fd tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] 10.222.0.30 "GET /compute/v2.1/servers/05981bed-b625-4e9a-b860-6a7ce1288e8d" status: 200 len: 1522 microversion: 2.1 time: 0.552603 Jun 16 18:30:15.251802 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 105/219] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:30:14 2022] GET /compute/v2.1/servers/05981bed-b625-4e9a-b860-6a7ce1288e8d => generated 1522 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:30:16.310158 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-c2e398f2-a822-46bf-83c6-6bbf11f06b03 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:30:16.315712 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-c2e398f2-a822-46bf-83c6-6bbf11f06b03 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] [instance: 05981bed-b625-4e9a-b860-6a7ce1288e8d] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:30:16.332170 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-c2e398f2-a822-46bf-83c6-6bbf11f06b03 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:30:16.333779 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-c2e398f2-a822-46bf-83c6-6bbf11f06b03 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:30:16.335809 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-c2e398f2-a822-46bf-83c6-6bbf11f06b03 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:30:16.337100 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-c2e398f2-a822-46bf-83c6-6bbf11f06b03 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:30:16.918863 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-c2e398f2-a822-46bf-83c6-6bbf11f06b03 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512f01cca14b447c8f6c9eebbd828eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70bbccf07e3404cb94ba59201061a6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:30:16.970959 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-c2e398f2-a822-46bf-83c6-6bbf11f06b03 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] 10.222.0.30 "GET /compute/v2.1/servers/05981bed-b625-4e9a-b860-6a7ce1288e8d" status: 200 len: 1522 microversion: 2.1 time: 0.698426 Jun 16 18:30:16.972127 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 115/220] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:30:16 2022] GET /compute/v2.1/servers/05981bed-b625-4e9a-b860-6a7ce1288e8d => generated 1522 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:30:17.990594 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-800b9156-27ed-42fc-8935-df944be023fa tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:30:17.991239 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-800b9156-27ed-42fc-8935-df944be023fa tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] [instance: 05981bed-b625-4e9a-b860-6a7ce1288e8d] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:30:18.010585 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-800b9156-27ed-42fc-8935-df944be023fa tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:30:18.012364 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-800b9156-27ed-42fc-8935-df944be023fa tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:30:18.013349 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-800b9156-27ed-42fc-8935-df944be023fa tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:30:18.014757 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-800b9156-27ed-42fc-8935-df944be023fa tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:30:18.367787 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-800b9156-27ed-42fc-8935-df944be023fa tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512f01cca14b447c8f6c9eebbd828eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70bbccf07e3404cb94ba59201061a6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:30:18.381457 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-800b9156-27ed-42fc-8935-df944be023fa tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] 10.222.0.30 "GET /compute/v2.1/servers/05981bed-b625-4e9a-b860-6a7ce1288e8d" status: 200 len: 1522 microversion: 2.1 time: 0.394686 Jun 16 18:30:18.383579 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 106/221] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:30:17 2022] GET /compute/v2.1/servers/05981bed-b625-4e9a-b860-6a7ce1288e8d => generated 1522 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:30:19.416340 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-1bdcd8a8-7b70-46fd-8ab1-9aa909b4b9df tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:30:19.419060 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-1bdcd8a8-7b70-46fd-8ab1-9aa909b4b9df tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] [instance: 05981bed-b625-4e9a-b860-6a7ce1288e8d] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:30:19.431290 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-1bdcd8a8-7b70-46fd-8ab1-9aa909b4b9df tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:30:19.432582 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-1bdcd8a8-7b70-46fd-8ab1-9aa909b4b9df tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:30:19.434296 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-1bdcd8a8-7b70-46fd-8ab1-9aa909b4b9df tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:30:19.435409 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-1bdcd8a8-7b70-46fd-8ab1-9aa909b4b9df tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:30:19.726699 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-1bdcd8a8-7b70-46fd-8ab1-9aa909b4b9df tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512f01cca14b447c8f6c9eebbd828eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70bbccf07e3404cb94ba59201061a6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:30:19.742071 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-1bdcd8a8-7b70-46fd-8ab1-9aa909b4b9df tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] 10.222.0.30 "GET /compute/v2.1/servers/05981bed-b625-4e9a-b860-6a7ce1288e8d" status: 200 len: 1522 microversion: 2.1 time: 0.335690 Jun 16 18:30:19.742672 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 116/222] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:30:19 2022] GET /compute/v2.1/servers/05981bed-b625-4e9a-b860-6a7ce1288e8d => generated 1522 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:30:20.765993 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-31872a9a-22dd-4144-972e-409918813d6d tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:30:20.767346 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-31872a9a-22dd-4144-972e-409918813d6d tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] [instance: 05981bed-b625-4e9a-b860-6a7ce1288e8d] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:30:20.774501 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-31872a9a-22dd-4144-972e-409918813d6d tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:30:20.776039 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-31872a9a-22dd-4144-972e-409918813d6d tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:30:20.777582 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-31872a9a-22dd-4144-972e-409918813d6d tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:30:20.778272 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-31872a9a-22dd-4144-972e-409918813d6d tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:30:21.078217 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-31872a9a-22dd-4144-972e-409918813d6d tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512f01cca14b447c8f6c9eebbd828eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70bbccf07e3404cb94ba59201061a6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:30:21.110302 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-31872a9a-22dd-4144-972e-409918813d6d tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] 10.222.0.30 "GET /compute/v2.1/servers/05981bed-b625-4e9a-b860-6a7ce1288e8d" status: 200 len: 1522 microversion: 2.1 time: 0.347748 Jun 16 18:30:21.113303 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 107/223] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:30:20 2022] GET /compute/v2.1/servers/05981bed-b625-4e9a-b860-6a7ce1288e8d => generated 1522 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:30:22.143731 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-247c1093-408a-4e3f-a8c4-48d33fffaeb7 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:30:22.144900 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-247c1093-408a-4e3f-a8c4-48d33fffaeb7 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] [instance: 05981bed-b625-4e9a-b860-6a7ce1288e8d] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:30:22.163312 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-247c1093-408a-4e3f-a8c4-48d33fffaeb7 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:30:22.164418 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-247c1093-408a-4e3f-a8c4-48d33fffaeb7 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:30:22.166483 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-247c1093-408a-4e3f-a8c4-48d33fffaeb7 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:30:22.168004 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-247c1093-408a-4e3f-a8c4-48d33fffaeb7 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:30:22.597194 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-247c1093-408a-4e3f-a8c4-48d33fffaeb7 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512f01cca14b447c8f6c9eebbd828eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70bbccf07e3404cb94ba59201061a6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:30:22.623639 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-247c1093-408a-4e3f-a8c4-48d33fffaeb7 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] 10.222.0.30 "GET /compute/v2.1/servers/05981bed-b625-4e9a-b860-6a7ce1288e8d" status: 200 len: 1522 microversion: 2.1 time: 0.486413 Jun 16 18:30:22.624648 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 117/224] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:30:22 2022] GET /compute/v2.1/servers/05981bed-b625-4e9a-b860-6a7ce1288e8d => generated 1522 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:30:23.651082 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-a16ee8a9-ad13-4f3e-ac8c-35bb4396b094 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:30:23.652737 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-a16ee8a9-ad13-4f3e-ac8c-35bb4396b094 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] [instance: 05981bed-b625-4e9a-b860-6a7ce1288e8d] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:30:23.660086 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-a16ee8a9-ad13-4f3e-ac8c-35bb4396b094 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:30:23.660538 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-a16ee8a9-ad13-4f3e-ac8c-35bb4396b094 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:30:23.661357 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-a16ee8a9-ad13-4f3e-ac8c-35bb4396b094 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:30:23.661804 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-a16ee8a9-ad13-4f3e-ac8c-35bb4396b094 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:30:23.875929 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-a16ee8a9-ad13-4f3e-ac8c-35bb4396b094 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512f01cca14b447c8f6c9eebbd828eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70bbccf07e3404cb94ba59201061a6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:30:23.891106 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-a16ee8a9-ad13-4f3e-ac8c-35bb4396b094 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] 10.222.0.30 "GET /compute/v2.1/servers/05981bed-b625-4e9a-b860-6a7ce1288e8d" status: 200 len: 1522 microversion: 2.1 time: 0.244740 Jun 16 18:30:23.898811 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 108/225] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:30:23 2022] GET /compute/v2.1/servers/05981bed-b625-4e9a-b860-6a7ce1288e8d => generated 1522 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:30:24.933608 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-999aaceb-25a4-4b19-ad36-210c5bab82c2 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:30:24.937803 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-999aaceb-25a4-4b19-ad36-210c5bab82c2 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] [instance: 05981bed-b625-4e9a-b860-6a7ce1288e8d] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:30:24.956706 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-999aaceb-25a4-4b19-ad36-210c5bab82c2 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:30:24.961202 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-999aaceb-25a4-4b19-ad36-210c5bab82c2 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:30:24.963013 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-999aaceb-25a4-4b19-ad36-210c5bab82c2 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:30:24.965932 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-999aaceb-25a4-4b19-ad36-210c5bab82c2 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:30:25.629401 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-999aaceb-25a4-4b19-ad36-210c5bab82c2 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512f01cca14b447c8f6c9eebbd828eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70bbccf07e3404cb94ba59201061a6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:30:25.659658 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-999aaceb-25a4-4b19-ad36-210c5bab82c2 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] 10.222.0.30 "GET /compute/v2.1/servers/05981bed-b625-4e9a-b860-6a7ce1288e8d" status: 200 len: 1522 microversion: 2.1 time: 0.743820 Jun 16 18:30:25.663648 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 118/226] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:30:24 2022] GET /compute/v2.1/servers/05981bed-b625-4e9a-b860-6a7ce1288e8d => generated 1522 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:30:26.680466 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-3480bd58-9b39-4761-9d96-9334b92e2678 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:30:26.681974 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-3480bd58-9b39-4761-9d96-9334b92e2678 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] [instance: 05981bed-b625-4e9a-b860-6a7ce1288e8d] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:30:26.708248 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-3480bd58-9b39-4761-9d96-9334b92e2678 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:30:26.708894 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-3480bd58-9b39-4761-9d96-9334b92e2678 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:30:26.709734 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-3480bd58-9b39-4761-9d96-9334b92e2678 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:30:26.710177 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-3480bd58-9b39-4761-9d96-9334b92e2678 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:30:27.108602 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-3480bd58-9b39-4761-9d96-9334b92e2678 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512f01cca14b447c8f6c9eebbd828eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70bbccf07e3404cb94ba59201061a6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:30:27.117273 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-3480bd58-9b39-4761-9d96-9334b92e2678 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] 10.222.0.30 "GET /compute/v2.1/servers/05981bed-b625-4e9a-b860-6a7ce1288e8d" status: 200 len: 1522 microversion: 2.1 time: 0.441437 Jun 16 18:30:27.140127 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 109/227] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:30:26 2022] GET /compute/v2.1/servers/05981bed-b625-4e9a-b860-6a7ce1288e8d => generated 1522 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:30:28.163172 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-bb26b1a6-2de6-49ba-bb4b-897cec407f6f tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:30:28.164212 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-bb26b1a6-2de6-49ba-bb4b-897cec407f6f tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] [instance: 05981bed-b625-4e9a-b860-6a7ce1288e8d] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:30:28.178530 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-bb26b1a6-2de6-49ba-bb4b-897cec407f6f tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:30:28.179145 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-bb26b1a6-2de6-49ba-bb4b-897cec407f6f tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:30:28.180507 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-bb26b1a6-2de6-49ba-bb4b-897cec407f6f tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:30:28.181784 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-bb26b1a6-2de6-49ba-bb4b-897cec407f6f tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:30:28.190800 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG dbcounter [-] [117670] Writing DB stats nova_cell1:SELECT=85 {{(pid=117670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:30:28.755558 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-bb26b1a6-2de6-49ba-bb4b-897cec407f6f tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512f01cca14b447c8f6c9eebbd828eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70bbccf07e3404cb94ba59201061a6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:30:28.791277 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-bb26b1a6-2de6-49ba-bb4b-897cec407f6f tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] 10.222.0.30 "GET /compute/v2.1/servers/05981bed-b625-4e9a-b860-6a7ce1288e8d" status: 200 len: 1522 microversion: 2.1 time: 0.635342 Jun 16 18:30:28.808452 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 119/228] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:30:28 2022] GET /compute/v2.1/servers/05981bed-b625-4e9a-b860-6a7ce1288e8d => generated 1522 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:30:29.823295 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-99142812-bd38-4dc5-9383-6e946568ef0e tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:30:29.825016 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-99142812-bd38-4dc5-9383-6e946568ef0e tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] [instance: 05981bed-b625-4e9a-b860-6a7ce1288e8d] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:30:29.842605 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-99142812-bd38-4dc5-9383-6e946568ef0e tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:30:29.845766 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-99142812-bd38-4dc5-9383-6e946568ef0e tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:30:29.850095 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-99142812-bd38-4dc5-9383-6e946568ef0e tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:30:29.851266 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-99142812-bd38-4dc5-9383-6e946568ef0e tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:30:30.821440 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-99142812-bd38-4dc5-9383-6e946568ef0e tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512f01cca14b447c8f6c9eebbd828eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70bbccf07e3404cb94ba59201061a6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:30:30.840727 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-99142812-bd38-4dc5-9383-6e946568ef0e tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] 10.222.0.30 "GET /compute/v2.1/servers/05981bed-b625-4e9a-b860-6a7ce1288e8d" status: 200 len: 1522 microversion: 2.1 time: 1.020405 Jun 16 18:30:30.844311 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 110/229] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:30:29 2022] GET /compute/v2.1/servers/05981bed-b625-4e9a-b860-6a7ce1288e8d => generated 1522 bytes in 1027 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:30:31.881031 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-ab849df7-f207-49a3-9753-32a1929699a7 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:30:31.886801 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-ab849df7-f207-49a3-9753-32a1929699a7 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] [instance: 05981bed-b625-4e9a-b860-6a7ce1288e8d] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:30:31.926566 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-ab849df7-f207-49a3-9753-32a1929699a7 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:30:31.927868 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-ab849df7-f207-49a3-9753-32a1929699a7 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:30:31.929688 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-ab849df7-f207-49a3-9753-32a1929699a7 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:30:31.931525 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-ab849df7-f207-49a3-9753-32a1929699a7 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:30:32.301238 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-ab849df7-f207-49a3-9753-32a1929699a7 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512f01cca14b447c8f6c9eebbd828eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70bbccf07e3404cb94ba59201061a6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:30:32.311654 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-ab849df7-f207-49a3-9753-32a1929699a7 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] 10.222.0.30 "GET /compute/v2.1/servers/05981bed-b625-4e9a-b860-6a7ce1288e8d" status: 200 len: 1522 microversion: 2.1 time: 0.443644 Jun 16 18:30:32.314134 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 120/230] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:30:31 2022] GET /compute/v2.1/servers/05981bed-b625-4e9a-b860-6a7ce1288e8d => generated 1522 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:30:32.567027 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-f1e23126-2ad4-4a40-a01f-6991feb9d242 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:30:32.569081 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-f1e23126-2ad4-4a40-a01f-6991feb9d242 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] [instance: 121f052a-2d96-444d-a817-38e348aaf0e5] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:30:32.609454 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-f1e23126-2ad4-4a40-a01f-6991feb9d242 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:30:32.610399 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-f1e23126-2ad4-4a40-a01f-6991feb9d242 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:30:32.611924 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-f1e23126-2ad4-4a40-a01f-6991feb9d242 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:30:32.613060 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-f1e23126-2ad4-4a40-a01f-6991feb9d242 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:30:32.683003 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-f1e23126-2ad4-4a40-a01f-6991feb9d242 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] 10.222.0.30 "GET /compute/v2.1/servers/121f052a-2d96-444d-a817-38e348aaf0e5/ips" status: 200 len: 149 microversion: 2.1 time: 0.130200 Jun 16 18:30:32.684546 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 111/231] 10.222.0.30 () {58 vars in 1247 bytes} [Thu Jun 16 18:30:32 2022] GET /compute/v2.1/servers/121f052a-2d96-444d-a817-38e348aaf0e5/ips => generated 149 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:30:33.342644 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-c7de332f-a894-4dd3-9982-428abe04b5d1 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:30:33.344171 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-c7de332f-a894-4dd3-9982-428abe04b5d1 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] [instance: 05981bed-b625-4e9a-b860-6a7ce1288e8d] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:30:33.347279 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG dbcounter [-] [117670] Writing DB stats nova_api:SELECT=24 {{(pid=117670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:30:33.393085 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-c7de332f-a894-4dd3-9982-428abe04b5d1 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:30:33.393567 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-c7de332f-a894-4dd3-9982-428abe04b5d1 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:30:33.397178 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-c7de332f-a894-4dd3-9982-428abe04b5d1 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:30:33.398144 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-c7de332f-a894-4dd3-9982-428abe04b5d1 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:30:33.688699 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-c7de332f-a894-4dd3-9982-428abe04b5d1 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512f01cca14b447c8f6c9eebbd828eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70bbccf07e3404cb94ba59201061a6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:30:33.700843 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-c7de332f-a894-4dd3-9982-428abe04b5d1 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] 10.222.0.30 "GET /compute/v2.1/servers/05981bed-b625-4e9a-b860-6a7ce1288e8d" status: 200 len: 1522 microversion: 2.1 time: 0.364778 Jun 16 18:30:33.701919 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 121/232] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:30:33 2022] GET /compute/v2.1/servers/05981bed-b625-4e9a-b860-6a7ce1288e8d => generated 1522 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:30:34.736328 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-93c2ccef-32a6-40ac-9864-28492464dfe2 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:30:34.737410 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-93c2ccef-32a6-40ac-9864-28492464dfe2 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] [instance: 05981bed-b625-4e9a-b860-6a7ce1288e8d] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:30:34.777227 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG dbcounter [-] [117671] Writing DB stats nova_api:SELECT=26 {{(pid=117671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:30:34.794614 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-93c2ccef-32a6-40ac-9864-28492464dfe2 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:30:34.795068 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-93c2ccef-32a6-40ac-9864-28492464dfe2 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:30:34.797406 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-93c2ccef-32a6-40ac-9864-28492464dfe2 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:30:34.797856 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-93c2ccef-32a6-40ac-9864-28492464dfe2 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:30:34.865818 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-80dd5755-5678-4eda-b37f-529b9e9c82bd tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "07b1d436-a3e6-4fa5-905b-3e36b8061271"}} {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:30:34.884726 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-80dd5755-5678-4eda-b37f-529b9e9c82bd tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] [instance: 121f052a-2d96-444d-a817-38e348aaf0e5] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:30:34.903720 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-80dd5755-5678-4eda-b37f-529b9e9c82bd tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:30:34.904668 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-80dd5755-5678-4eda-b37f-529b9e9c82bd tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:30:34.905796 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-80dd5755-5678-4eda-b37f-529b9e9c82bd tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:30:34.906421 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-80dd5755-5678-4eda-b37f-529b9e9c82bd tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:30:35.131494 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-93c2ccef-32a6-40ac-9864-28492464dfe2 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512f01cca14b447c8f6c9eebbd828eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70bbccf07e3404cb94ba59201061a6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:30:35.161917 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-93c2ccef-32a6-40ac-9864-28492464dfe2 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] 10.222.0.30 "GET /compute/v2.1/servers/05981bed-b625-4e9a-b860-6a7ce1288e8d" status: 200 len: 1502 microversion: 2.1 time: 0.436644 Jun 16 18:30:35.162521 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 112/233] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:30:34 2022] GET /compute/v2.1/servers/05981bed-b625-4e9a-b860-6a7ce1288e8d => generated 1502 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:30:35.203001 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-66046f25-1591-45fb-844c-10cb78a354fe tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:30:35.206646 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-66046f25-1591-45fb-844c-10cb78a354fe tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] [instance: e541a8c3-c14c-46db-8b18-23fff07aa1d2] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:30:35.223678 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-66046f25-1591-45fb-844c-10cb78a354fe tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:30:35.226811 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-66046f25-1591-45fb-844c-10cb78a354fe tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:30:35.228828 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-66046f25-1591-45fb-844c-10cb78a354fe tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:30:35.229405 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-66046f25-1591-45fb-844c-10cb78a354fe tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:30:35.911895 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-66046f25-1591-45fb-844c-10cb78a354fe tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512f01cca14b447c8f6c9eebbd828eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70bbccf07e3404cb94ba59201061a6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:30:35.930090 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG dbcounter [-] [117671] Writing DB stats nova_cell1:SELECT=67 {{(pid=117671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:30:35.991137 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-66046f25-1591-45fb-844c-10cb78a354fe tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] 10.222.0.30 "GET /compute/v2.1/servers/e541a8c3-c14c-46db-8b18-23fff07aa1d2" status: 200 len: 1515 microversion: 2.1 time: 0.795500 Jun 16 18:30:35.992338 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 113/234] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:30:35 2022] GET /compute/v2.1/servers/e541a8c3-c14c-46db-8b18-23fff07aa1d2 => generated 1515 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:30:36.130757 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-80dd5755-5678-4eda-b37f-529b9e9c82bd tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] 10.222.0.30 "POST /compute/v2.1/servers/121f052a-2d96-444d-a817-38e348aaf0e5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.269951 Jun 16 18:30:36.156176 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 122/235] 10.222.0.30 () {60 vars in 1322 bytes} [Thu Jun 16 18:30:34 2022] POST /compute/v2.1/servers/121f052a-2d96-444d-a817-38e348aaf0e5/os-volume_attachments => generated 194 bytes in 1302 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 18:30:39.073459 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-9567db75-f341-45f8-b176-b50192fc7aab tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:30:39.076541 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-9567db75-f341-45f8-b176-b50192fc7aab tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] [instance: e541a8c3-c14c-46db-8b18-23fff07aa1d2] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:30:39.113868 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-9567db75-f341-45f8-b176-b50192fc7aab tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:30:39.114635 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-9567db75-f341-45f8-b176-b50192fc7aab tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:30:39.116064 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-9567db75-f341-45f8-b176-b50192fc7aab tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:30:39.137686 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-9567db75-f341-45f8-b176-b50192fc7aab tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:30:39.352447 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.objects.instance [None req-9567db75-f341-45f8-b176-b50192fc7aab tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lazy-loading 'flavor' on Instance uuid e541a8c3-c14c-46db-8b18-23fff07aa1d2 {{(pid=117671) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 18:30:40.095359 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-9567db75-f341-45f8-b176-b50192fc7aab tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] 10.222.0.30 "POST /compute/v2.1/servers/e541a8c3-c14c-46db-8b18-23fff07aa1d2/action" status: 200 len: 32 microversion: 2.1 time: 1.032142 Jun 16 18:30:40.107651 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 114/236] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Jun 16 18:30:39 2022] POST /compute/v2.1/servers/e541a8c3-c14c-46db-8b18-23fff07aa1d2/action => generated 32 bytes in 1046 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 16 18:30:40.123882 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-e598fe58-f6a1-4059-8bec-bfcde944a99e tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:30:40.125731 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-e598fe58-f6a1-4059-8bec-bfcde944a99e tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] [instance: e541a8c3-c14c-46db-8b18-23fff07aa1d2] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:30:40.155170 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-e598fe58-f6a1-4059-8bec-bfcde944a99e tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:30:40.157434 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-e598fe58-f6a1-4059-8bec-bfcde944a99e tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:30:40.159416 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-e598fe58-f6a1-4059-8bec-bfcde944a99e tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:30:40.160586 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-e598fe58-f6a1-4059-8bec-bfcde944a99e tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:30:41.108876 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-e598fe58-f6a1-4059-8bec-bfcde944a99e tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512f01cca14b447c8f6c9eebbd828eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70bbccf07e3404cb94ba59201061a6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:30:41.137155 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-e598fe58-f6a1-4059-8bec-bfcde944a99e tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] 10.222.0.30 "GET /compute/v2.1/servers/e541a8c3-c14c-46db-8b18-23fff07aa1d2" status: 200 len: 1521 microversion: 2.1 time: 1.022867 Jun 16 18:30:41.147885 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 123/237] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:30:40 2022] GET /compute/v2.1/servers/e541a8c3-c14c-46db-8b18-23fff07aa1d2 => generated 1521 bytes in 1035 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:30:42.195360 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-4a1bf2f9-1c1c-4dcd-885e-75b8464f9606 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:30:42.202789 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-4a1bf2f9-1c1c-4dcd-885e-75b8464f9606 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] [instance: e541a8c3-c14c-46db-8b18-23fff07aa1d2] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:30:42.293220 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-4a1bf2f9-1c1c-4dcd-885e-75b8464f9606 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:30:42.307466 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-4a1bf2f9-1c1c-4dcd-885e-75b8464f9606 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:30:42.329411 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-4a1bf2f9-1c1c-4dcd-885e-75b8464f9606 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:30:42.331539 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-4a1bf2f9-1c1c-4dcd-885e-75b8464f9606 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:30:43.716018 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-4a1bf2f9-1c1c-4dcd-885e-75b8464f9606 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512f01cca14b447c8f6c9eebbd828eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70bbccf07e3404cb94ba59201061a6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:30:43.751224 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-4a1bf2f9-1c1c-4dcd-885e-75b8464f9606 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] 10.222.0.30 "GET /compute/v2.1/servers/e541a8c3-c14c-46db-8b18-23fff07aa1d2" status: 200 len: 1521 microversion: 2.1 time: 1.592548 Jun 16 18:30:43.764291 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 115/238] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:30:42 2022] GET /compute/v2.1/servers/e541a8c3-c14c-46db-8b18-23fff07aa1d2 => generated 1521 bytes in 1610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:30:44.777328 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-09b8cfac-a09a-40af-bf04-92ad0e95a9b3 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:30:44.792957 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-09b8cfac-a09a-40af-bf04-92ad0e95a9b3 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] [instance: e541a8c3-c14c-46db-8b18-23fff07aa1d2] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:30:44.835122 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-09b8cfac-a09a-40af-bf04-92ad0e95a9b3 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:30:44.840758 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-09b8cfac-a09a-40af-bf04-92ad0e95a9b3 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:30:44.861935 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-09b8cfac-a09a-40af-bf04-92ad0e95a9b3 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:30:44.862757 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-09b8cfac-a09a-40af-bf04-92ad0e95a9b3 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:30:45.578403 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-09b8cfac-a09a-40af-bf04-92ad0e95a9b3 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512f01cca14b447c8f6c9eebbd828eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70bbccf07e3404cb94ba59201061a6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:30:45.621215 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-09b8cfac-a09a-40af-bf04-92ad0e95a9b3 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] 10.222.0.30 "GET /compute/v2.1/servers/e541a8c3-c14c-46db-8b18-23fff07aa1d2" status: 200 len: 1521 microversion: 2.1 time: 0.840842 Jun 16 18:30:45.637719 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 124/239] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:30:44 2022] GET /compute/v2.1/servers/e541a8c3-c14c-46db-8b18-23fff07aa1d2 => generated 1521 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:30:46.049333 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-bf45863f-89d1-4bcc-8b85-4a094a60f62f tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Action: 'create', calling method: .version_select at 0x7fbb302eadc0>, body: {"keypair": {"name": "tempest-keypair-1549589118", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHKQtLyXR3Eaod/kZyybfiKx27P7eF8kcrYL/KNl2zEzULJ2XvfbhQ7vB/UsPdeEAF9D4NYFOCDAmM2kCil8dsFQQlg5V0onMUvD2ARmZV4R9DfumkHy2MA0mGJk0hIGGw=="}} {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:30:46.120600 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.quota [None req-bf45863f-89d1-4bcc-8b85-4a094a60f62f tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Getting quotas for project 1f0473c6214a4428be438fabc530012b. Resources: {'key_pairs'} {{(pid=117671) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 18:30:46.152868 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.quota [None req-bf45863f-89d1-4bcc-8b85-4a094a60f62f tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Getting quotas for user 89f6c755dbf74640a372802f02733eb3 and project 1f0473c6214a4428be438fabc530012b. Resources: {'key_pairs'} {{(pid=117671) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 18:30:46.250792 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-bf45863f-89d1-4bcc-8b85-4a094a60f62f tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.207014 Jun 16 18:30:46.264233 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 116/240] 10.222.0.30 () {60 vars in 1158 bytes} [Thu Jun 16 18:30:46 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:30:46.653245 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-f71367ca-1306-4bc1-bde9-1da09e935823 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:30:46.654490 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-f71367ca-1306-4bc1-bde9-1da09e935823 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] [instance: e541a8c3-c14c-46db-8b18-23fff07aa1d2] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:30:46.714016 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-f71367ca-1306-4bc1-bde9-1da09e935823 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:30:46.721808 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-f71367ca-1306-4bc1-bde9-1da09e935823 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:30:46.725923 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-f71367ca-1306-4bc1-bde9-1da09e935823 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:30:46.754482 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-f71367ca-1306-4bc1-bde9-1da09e935823 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:30:47.402298 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-f71367ca-1306-4bc1-bde9-1da09e935823 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512f01cca14b447c8f6c9eebbd828eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70bbccf07e3404cb94ba59201061a6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:30:47.448606 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-f71367ca-1306-4bc1-bde9-1da09e935823 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] 10.222.0.30 "GET /compute/v2.1/servers/e541a8c3-c14c-46db-8b18-23fff07aa1d2" status: 200 len: 1521 microversion: 2.1 time: 0.812643 Jun 16 18:30:47.452932 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 125/241] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:30:46 2022] GET /compute/v2.1/servers/e541a8c3-c14c-46db-8b18-23fff07aa1d2 => generated 1521 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:30:48.474040 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-23fc7eca-96f1-4d9d-bfe6-72f15c6183aa tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:30:48.474913 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-23fc7eca-96f1-4d9d-bfe6-72f15c6183aa tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] [instance: e541a8c3-c14c-46db-8b18-23fff07aa1d2] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:30:48.497828 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-23fc7eca-96f1-4d9d-bfe6-72f15c6183aa tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:30:48.499512 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-23fc7eca-96f1-4d9d-bfe6-72f15c6183aa tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:30:48.501776 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-23fc7eca-96f1-4d9d-bfe6-72f15c6183aa tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:30:48.503247 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-23fc7eca-96f1-4d9d-bfe6-72f15c6183aa tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:30:49.059865 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-23fc7eca-96f1-4d9d-bfe6-72f15c6183aa tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512f01cca14b447c8f6c9eebbd828eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70bbccf07e3404cb94ba59201061a6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:30:49.085949 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-23fc7eca-96f1-4d9d-bfe6-72f15c6183aa tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] 10.222.0.30 "GET /compute/v2.1/servers/e541a8c3-c14c-46db-8b18-23fff07aa1d2" status: 200 len: 1521 microversion: 2.1 time: 0.611165 Jun 16 18:30:49.088162 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 117/242] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:30:48 2022] GET /compute/v2.1/servers/e541a8c3-c14c-46db-8b18-23fff07aa1d2 => generated 1521 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:30:50.128597 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-f2d49651-37ae-43dd-9869-a313b36392b6 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:30:50.130023 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-f2d49651-37ae-43dd-9869-a313b36392b6 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] [instance: e541a8c3-c14c-46db-8b18-23fff07aa1d2] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:30:50.158536 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-f2d49651-37ae-43dd-9869-a313b36392b6 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:30:50.159999 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-f2d49651-37ae-43dd-9869-a313b36392b6 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:30:50.162388 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-f2d49651-37ae-43dd-9869-a313b36392b6 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:30:50.163063 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-f2d49651-37ae-43dd-9869-a313b36392b6 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:30:50.354518 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-ec6a9252-d059-4406-a1fd-f1bf225fe0ed tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1499170018", "imageRef": "38ef083a-a9ff-4836-8954-f770268ba205", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8dc64fea-6d01-44bc-9636-d5525e5d1ec1"}], "security_groups": [{"name": "tempest-securitygroup--1940099984"}], "key_name": "tempest-keypair-1549589118", "user_data": "}} {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:30:50.572709 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-f2d49651-37ae-43dd-9869-a313b36392b6 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512f01cca14b447c8f6c9eebbd828eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70bbccf07e3404cb94ba59201061a6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:30:50.586671 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-f2d49651-37ae-43dd-9869-a313b36392b6 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] 10.222.0.30 "GET /compute/v2.1/servers/e541a8c3-c14c-46db-8b18-23fff07aa1d2" status: 200 len: 1521 microversion: 2.1 time: 0.476503 Jun 16 18:30:50.589082 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 126/243] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:30:50 2022] GET /compute/v2.1/servers/e541a8c3-c14c-46db-8b18-23fff07aa1d2 => generated 1521 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:30:50.761584 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.network.neutron [None req-ec6a9252-d059-4406-a1fd-f1bf225fe0ed tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] validate_networks() for [('8dc64fea-6d01-44bc-9636-d5525e5d1ec1', None, None, None, None, None)] {{(pid=117671) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 18:30:51.630423 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-6b12d072-5bdb-4b60-a35f-8dc0760a9753 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:30:51.632287 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-6b12d072-5bdb-4b60-a35f-8dc0760a9753 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] [instance: e541a8c3-c14c-46db-8b18-23fff07aa1d2] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:30:51.666791 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-6b12d072-5bdb-4b60-a35f-8dc0760a9753 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:30:51.670740 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-6b12d072-5bdb-4b60-a35f-8dc0760a9753 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:30:51.674489 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-6b12d072-5bdb-4b60-a35f-8dc0760a9753 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:30:51.675675 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-6b12d072-5bdb-4b60-a35f-8dc0760a9753 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:30:52.215330 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.virt.hardware [None req-ec6a9252-d059-4406-a1fd-f1bf225fe0ed tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Flavor limits 0:0:0 {{(pid=117671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 18:30:52.217031 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.virt.hardware [None req-ec6a9252-d059-4406-a1fd-f1bf225fe0ed tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Image limits 0:0:0 {{(pid=117671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 18:30:52.219193 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.virt.hardware [None req-ec6a9252-d059-4406-a1fd-f1bf225fe0ed tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Flavor pref 0:0:0 {{(pid=117671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 18:30:52.220987 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.virt.hardware [None req-ec6a9252-d059-4406-a1fd-f1bf225fe0ed tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Image pref 0:0:0 {{(pid=117671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 18:30:52.221418 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.virt.hardware [None req-ec6a9252-d059-4406-a1fd-f1bf225fe0ed tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 18:30:52.252698 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-ec6a9252-d059-4406-a1fd-f1bf225fe0ed tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:30:52.255608 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-ec6a9252-d059-4406-a1fd-f1bf225fe0ed tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:30:52.259805 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-ec6a9252-d059-4406-a1fd-f1bf225fe0ed tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:30:52.262375 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-ec6a9252-d059-4406-a1fd-f1bf225fe0ed tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:30:52.326727 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.quota [None req-ec6a9252-d059-4406-a1fd-f1bf225fe0ed tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Getting quotas for project 1f0473c6214a4428be438fabc530012b. Resources: {'instances', 'ram', 'cores'} {{(pid=117671) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 18:30:52.341829 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.quota [None req-ec6a9252-d059-4406-a1fd-f1bf225fe0ed tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Getting quotas for user 89f6c755dbf74640a372802f02733eb3 and project 1f0473c6214a4428be438fabc530012b. Resources: {'instances', 'ram', 'cores'} {{(pid=117671) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 18:30:52.380376 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-ec6a9252-d059-4406-a1fd-f1bf225fe0ed tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Going to run 1 instances... {{(pid=117671) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 18:30:52.394668 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-ec6a9252-d059-4406-a1fd-f1bf225fe0ed tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] [instance: e1382e00-fe71-4915-b4d8-0669cce4072d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='38ef083a-a9ff-4836-8954-f770268ba205',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117671) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 18:30:52.476455 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-6b12d072-5bdb-4b60-a35f-8dc0760a9753 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512f01cca14b447c8f6c9eebbd828eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70bbccf07e3404cb94ba59201061a6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:30:52.536333 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-ec6a9252-d059-4406-a1fd-f1bf225fe0ed tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.192211 Jun 16 18:30:52.537541 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-6b12d072-5bdb-4b60-a35f-8dc0760a9753 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] 10.222.0.30 "GET /compute/v2.1/servers/e541a8c3-c14c-46db-8b18-23fff07aa1d2" status: 200 len: 1521 microversion: 2.1 time: 0.924346 Jun 16 18:30:52.543100 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 127/244] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:30:51 2022] GET /compute/v2.1/servers/e541a8c3-c14c-46db-8b18-23fff07aa1d2 => generated 1521 bytes in 932 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:30:52.544889 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 118/245] 10.222.0.30 () {60 vars in 1146 bytes} [Thu Jun 16 18:30:50 2022] POST /compute/v2.1/servers => generated 402 bytes in 2201 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 18:30:52.556850 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-0bcc2793-8efe-4f99-98a5-7787a17de664 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:30:52.558386 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-0bcc2793-8efe-4f99-98a5-7787a17de664 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] [instance: e1382e00-fe71-4915-b4d8-0669cce4072d] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:30:52.582725 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-5f531433-495a-40d4-9ff5-8c117bd89c07 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:30:52.588337 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-5f531433-495a-40d4-9ff5-8c117bd89c07 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] [instance: 651b5fe1-0df7-4bc6-b18e-7caea544a93f] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:30:52.620903 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-5f531433-495a-40d4-9ff5-8c117bd89c07 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:30:52.622549 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-5f531433-495a-40d4-9ff5-8c117bd89c07 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:30:52.625748 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-5f531433-495a-40d4-9ff5-8c117bd89c07 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:30:52.626867 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-5f531433-495a-40d4-9ff5-8c117bd89c07 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:30:52.688966 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-5f531433-495a-40d4-9ff5-8c117bd89c07 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] 10.222.0.30 "GET /compute/v2.1/servers/651b5fe1-0df7-4bc6-b18e-7caea544a93f/ips" status: 200 len: 152 microversion: 2.20 time: 0.140028 Jun 16 18:30:52.701469 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 128/246] 10.222.0.30 () {60 vars in 1288 bytes} [Thu Jun 16 18:30:52 2022] GET /compute/v2.1/servers/651b5fe1-0df7-4bc6-b18e-7caea544a93f/ips => generated 152 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 18:30:52.800428 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-0bcc2793-8efe-4f99-98a5-7787a17de664 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f6c755dbf74640a372802f02733eb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f0473c6214a4428be438fabc530012b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:30:52.832474 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-0bcc2793-8efe-4f99-98a5-7787a17de664 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] 10.222.0.30 "GET /compute/v2.1/servers/e1382e00-fe71-4915-b4d8-0669cce4072d" status: 200 len: 1242 microversion: 2.1 time: 0.283173 Jun 16 18:30:52.840936 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 119/247] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:30:52 2022] GET /compute/v2.1/servers/e1382e00-fe71-4915-b4d8-0669cce4072d => generated 1242 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:30:53.570295 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-1337594f-4e4f-4fad-a4c6-2e41df4c5a81 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:30:53.571205 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-1337594f-4e4f-4fad-a4c6-2e41df4c5a81 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] [instance: e541a8c3-c14c-46db-8b18-23fff07aa1d2] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:30:53.593076 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-1337594f-4e4f-4fad-a4c6-2e41df4c5a81 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:30:53.593714 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-1337594f-4e4f-4fad-a4c6-2e41df4c5a81 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:30:53.594550 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-1337594f-4e4f-4fad-a4c6-2e41df4c5a81 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:30:53.594992 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-1337594f-4e4f-4fad-a4c6-2e41df4c5a81 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:30:53.880279 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-dfa09acd-0083-4561-84d5-98ff3871d30c tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:30:53.891372 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-dfa09acd-0083-4561-84d5-98ff3871d30c tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] [instance: e1382e00-fe71-4915-b4d8-0669cce4072d] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:30:54.207064 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-dfa09acd-0083-4561-84d5-98ff3871d30c tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f6c755dbf74640a372802f02733eb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f0473c6214a4428be438fabc530012b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:30:54.227448 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-dfa09acd-0083-4561-84d5-98ff3871d30c tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] 10.222.0.30 "GET /compute/v2.1/servers/e1382e00-fe71-4915-b4d8-0669cce4072d" status: 200 len: 1242 microversion: 2.1 time: 0.375089 Jun 16 18:30:54.235217 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 120/248] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:30:53 2022] GET /compute/v2.1/servers/e1382e00-fe71-4915-b4d8-0669cce4072d => generated 1242 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:30:54.528747 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-1337594f-4e4f-4fad-a4c6-2e41df4c5a81 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512f01cca14b447c8f6c9eebbd828eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70bbccf07e3404cb94ba59201061a6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:30:54.551125 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-1337594f-4e4f-4fad-a4c6-2e41df4c5a81 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] 10.222.0.30 "GET /compute/v2.1/servers/e541a8c3-c14c-46db-8b18-23fff07aa1d2" status: 200 len: 1521 microversion: 2.1 time: 0.986585 Jun 16 18:30:54.569641 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 129/249] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:30:53 2022] GET /compute/v2.1/servers/e541a8c3-c14c-46db-8b18-23fff07aa1d2 => generated 1521 bytes in 1005 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:30:55.264733 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-c0c0f08c-5c3e-4b75-b4e9-5b82af77fe67 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:30:55.265912 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-c0c0f08c-5c3e-4b75-b4e9-5b82af77fe67 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] [instance: e1382e00-fe71-4915-b4d8-0669cce4072d] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:30:55.294854 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-c0c0f08c-5c3e-4b75-b4e9-5b82af77fe67 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:30:55.298310 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-c0c0f08c-5c3e-4b75-b4e9-5b82af77fe67 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:30:55.301724 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-c0c0f08c-5c3e-4b75-b4e9-5b82af77fe67 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:30:55.304784 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-c0c0f08c-5c3e-4b75-b4e9-5b82af77fe67 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:30:55.581904 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-ad17fef3-7434-4138-8630-63d99488123b tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:30:55.582910 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-ad17fef3-7434-4138-8630-63d99488123b tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] [instance: e541a8c3-c14c-46db-8b18-23fff07aa1d2] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:30:55.597555 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-ad17fef3-7434-4138-8630-63d99488123b tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:30:55.598672 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-ad17fef3-7434-4138-8630-63d99488123b tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:30:55.607688 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-ad17fef3-7434-4138-8630-63d99488123b tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:30:55.608453 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-ad17fef3-7434-4138-8630-63d99488123b tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:30:55.688887 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-c0c0f08c-5c3e-4b75-b4e9-5b82af77fe67 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f6c755dbf74640a372802f02733eb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f0473c6214a4428be438fabc530012b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:30:55.727955 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-c0c0f08c-5c3e-4b75-b4e9-5b82af77fe67 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] 10.222.0.30 "GET /compute/v2.1/servers/e1382e00-fe71-4915-b4d8-0669cce4072d" status: 200 len: 1294 microversion: 2.1 time: 0.470318 Jun 16 18:30:55.764289 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 121/250] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:30:55 2022] GET /compute/v2.1/servers/e1382e00-fe71-4915-b4d8-0669cce4072d => generated 1294 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:30:55.802674 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-90c9e10a-5fbd-454c-92c7-7ce50bb43827 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:30:55.815231 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-90c9e10a-5fbd-454c-92c7-7ce50bb43827 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] [instance: 651b5fe1-0df7-4bc6-b18e-7caea544a93f] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:30:55.880315 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-90c9e10a-5fbd-454c-92c7-7ce50bb43827 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:30:55.881194 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-90c9e10a-5fbd-454c-92c7-7ce50bb43827 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:30:55.882672 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-90c9e10a-5fbd-454c-92c7-7ce50bb43827 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:30:55.883400 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-90c9e10a-5fbd-454c-92c7-7ce50bb43827 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:30:56.070245 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.objects.instance [None req-90c9e10a-5fbd-454c-92c7-7ce50bb43827 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lazy-loading 'flavor' on Instance uuid 651b5fe1-0df7-4bc6-b18e-7caea544a93f {{(pid=117671) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 18:30:56.507006 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-ad17fef3-7434-4138-8630-63d99488123b tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512f01cca14b447c8f6c9eebbd828eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70bbccf07e3404cb94ba59201061a6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:30:56.551898 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-ad17fef3-7434-4138-8630-63d99488123b tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] 10.222.0.30 "GET /compute/v2.1/servers/e541a8c3-c14c-46db-8b18-23fff07aa1d2" status: 200 len: 1521 microversion: 2.1 time: 0.972963 Jun 16 18:30:56.581833 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 130/251] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:30:55 2022] GET /compute/v2.1/servers/e541a8c3-c14c-46db-8b18-23fff07aa1d2 => generated 1521 bytes in 1006 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:30:56.768866 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-d4b3c4be-280f-41cf-97b7-0bb22ff43ea0 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:30:56.774704 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-d4b3c4be-280f-41cf-97b7-0bb22ff43ea0 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] [instance: e1382e00-fe71-4915-b4d8-0669cce4072d] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:30:56.807533 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-d4b3c4be-280f-41cf-97b7-0bb22ff43ea0 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:30:56.807991 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-d4b3c4be-280f-41cf-97b7-0bb22ff43ea0 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:30:56.817407 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-d4b3c4be-280f-41cf-97b7-0bb22ff43ea0 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:30:56.820937 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-d4b3c4be-280f-41cf-97b7-0bb22ff43ea0 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:30:57.141281 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-d4b3c4be-280f-41cf-97b7-0bb22ff43ea0 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f6c755dbf74640a372802f02733eb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f0473c6214a4428be438fabc530012b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:30:57.175443 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-d4b3c4be-280f-41cf-97b7-0bb22ff43ea0 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] 10.222.0.30 "GET /compute/v2.1/servers/e1382e00-fe71-4915-b4d8-0669cce4072d" status: 200 len: 1300 microversion: 2.1 time: 0.413496 Jun 16 18:30:57.178155 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 131/252] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:30:56 2022] GET /compute/v2.1/servers/e1382e00-fe71-4915-b4d8-0669cce4072d => generated 1300 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:30:57.267222 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-90c9e10a-5fbd-454c-92c7-7ce50bb43827 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] 10.222.0.30 "POST /compute/v2.1/servers/651b5fe1-0df7-4bc6-b18e-7caea544a93f/action" status: 202 len: 0 microversion: 2.20 time: 1.499062 Jun 16 18:30:57.269494 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 122/253] 10.222.0.30 () {62 vars in 1318 bytes} [Thu Jun 16 18:30:55 2022] POST /compute/v2.1/servers/651b5fe1-0df7-4bc6-b18e-7caea544a93f/action => generated 0 bytes in 1503 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 16 18:30:57.282210 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-fbf647fd-7144-4475-b984-befdb0a72041 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:30:57.284309 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-fbf647fd-7144-4475-b984-befdb0a72041 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] [instance: 651b5fe1-0df7-4bc6-b18e-7caea544a93f] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:30:57.304177 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-fbf647fd-7144-4475-b984-befdb0a72041 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:30:57.307784 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-fbf647fd-7144-4475-b984-befdb0a72041 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:30:57.310873 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-fbf647fd-7144-4475-b984-befdb0a72041 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:30:57.312131 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-fbf647fd-7144-4475-b984-befdb0a72041 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:30:57.600749 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-f440c780-1037-4b57-b53b-475bfde13861 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:30:57.607480 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-f440c780-1037-4b57-b53b-475bfde13861 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] [instance: e541a8c3-c14c-46db-8b18-23fff07aa1d2] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:30:57.644264 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-f440c780-1037-4b57-b53b-475bfde13861 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:30:57.647939 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-f440c780-1037-4b57-b53b-475bfde13861 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:30:57.659355 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-f440c780-1037-4b57-b53b-475bfde13861 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:30:57.664612 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-f440c780-1037-4b57-b53b-475bfde13861 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:30:57.955160 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-fbf647fd-7144-4475-b984-befdb0a72041 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:30:57.987446 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-fbf647fd-7144-4475-b984-befdb0a72041 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:30:58.007443 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-fbf647fd-7144-4475-b984-befdb0a72041 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:30:58.014454 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-fbf647fd-7144-4475-b984-befdb0a72041 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] 10.222.0.30 "GET /compute/v2.1/servers/651b5fe1-0df7-4bc6-b18e-7caea544a93f" status: 200 len: 1724 microversion: 2.20 time: 0.737366 Jun 16 18:30:58.031283 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 132/254] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Jun 16 18:30:57 2022] GET /compute/v2.1/servers/651b5fe1-0df7-4bc6-b18e-7caea544a93f => generated 1724 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:30:58.201837 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-f440c780-1037-4b57-b53b-475bfde13861 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512f01cca14b447c8f6c9eebbd828eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70bbccf07e3404cb94ba59201061a6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:30:58.211568 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-afdc55d6-1ccb-4486-b39b-a09b68e1709d tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:30:58.217878 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-afdc55d6-1ccb-4486-b39b-a09b68e1709d tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] [instance: e1382e00-fe71-4915-b4d8-0669cce4072d] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:30:58.236275 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-f440c780-1037-4b57-b53b-475bfde13861 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] 10.222.0.30 "GET /compute/v2.1/servers/e541a8c3-c14c-46db-8b18-23fff07aa1d2" status: 200 len: 1521 microversion: 2.1 time: 0.649368 Jun 16 18:30:58.255423 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 123/255] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:30:57 2022] GET /compute/v2.1/servers/e541a8c3-c14c-46db-8b18-23fff07aa1d2 => generated 1521 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:30:58.255944 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-afdc55d6-1ccb-4486-b39b-a09b68e1709d tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:30:58.256926 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-afdc55d6-1ccb-4486-b39b-a09b68e1709d tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:30:58.258167 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-afdc55d6-1ccb-4486-b39b-a09b68e1709d tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:30:58.259763 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-afdc55d6-1ccb-4486-b39b-a09b68e1709d tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:30:58.300098 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG dbcounter [-] [117670] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:30:58.723103 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-afdc55d6-1ccb-4486-b39b-a09b68e1709d tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f6c755dbf74640a372802f02733eb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f0473c6214a4428be438fabc530012b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:30:58.737011 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-afdc55d6-1ccb-4486-b39b-a09b68e1709d tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] 10.222.0.30 "GET /compute/v2.1/servers/e1382e00-fe71-4915-b4d8-0669cce4072d" status: 200 len: 1368 microversion: 2.1 time: 0.541264 Jun 16 18:30:58.745392 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 133/256] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:30:58 2022] GET /compute/v2.1/servers/e1382e00-fe71-4915-b4d8-0669cce4072d => generated 1368 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:30:59.058664 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-3b19a2f3-2fde-42f1-a6fe-a9b609594e53 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:30:59.060498 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-3b19a2f3-2fde-42f1-a6fe-a9b609594e53 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] [instance: 651b5fe1-0df7-4bc6-b18e-7caea544a93f] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:30:59.123126 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-3b19a2f3-2fde-42f1-a6fe-a9b609594e53 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:30:59.123643 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-3b19a2f3-2fde-42f1-a6fe-a9b609594e53 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:30:59.124866 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-3b19a2f3-2fde-42f1-a6fe-a9b609594e53 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:30:59.125684 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-3b19a2f3-2fde-42f1-a6fe-a9b609594e53 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:30:59.269126 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-0c1b56e8-0773-46b1-99cb-ab220baf0b8a tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:30:59.275817 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-0c1b56e8-0773-46b1-99cb-ab220baf0b8a tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] [instance: e541a8c3-c14c-46db-8b18-23fff07aa1d2] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:30:59.302806 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-0c1b56e8-0773-46b1-99cb-ab220baf0b8a tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:30:59.314524 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-0c1b56e8-0773-46b1-99cb-ab220baf0b8a tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:30:59.319629 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-0c1b56e8-0773-46b1-99cb-ab220baf0b8a tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:30:59.326103 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-0c1b56e8-0773-46b1-99cb-ab220baf0b8a tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:30:59.685051 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-3b19a2f3-2fde-42f1-a6fe-a9b609594e53 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:30:59.746495 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-3b19a2f3-2fde-42f1-a6fe-a9b609594e53 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:30:59.756033 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-3b19a2f3-2fde-42f1-a6fe-a9b609594e53 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:30:59.762509 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-3b19a2f3-2fde-42f1-a6fe-a9b609594e53 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] 10.222.0.30 "GET /compute/v2.1/servers/651b5fe1-0df7-4bc6-b18e-7caea544a93f" status: 200 len: 1724 microversion: 2.20 time: 0.708353 Jun 16 18:30:59.764289 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 124/257] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Jun 16 18:30:59 2022] GET /compute/v2.1/servers/651b5fe1-0df7-4bc6-b18e-7caea544a93f => generated 1724 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:30:59.817208 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-84eb3af0-bf71-426b-b812-acf73d1f2d98 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:30:59.819792 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-84eb3af0-bf71-426b-b812-acf73d1f2d98 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] [instance: e1382e00-fe71-4915-b4d8-0669cce4072d] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:30:59.843053 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-84eb3af0-bf71-426b-b812-acf73d1f2d98 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:30:59.844756 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-84eb3af0-bf71-426b-b812-acf73d1f2d98 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:30:59.847133 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-84eb3af0-bf71-426b-b812-acf73d1f2d98 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:30:59.848386 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-84eb3af0-bf71-426b-b812-acf73d1f2d98 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:00.213797 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-84eb3af0-bf71-426b-b812-acf73d1f2d98 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f6c755dbf74640a372802f02733eb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f0473c6214a4428be438fabc530012b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:31:00.223492 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-84eb3af0-bf71-426b-b812-acf73d1f2d98 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] 10.222.0.30 "GET /compute/v2.1/servers/e1382e00-fe71-4915-b4d8-0669cce4072d" status: 200 len: 1368 microversion: 2.1 time: 0.427317 Jun 16 18:31:00.224034 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 125/258] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:30:59 2022] GET /compute/v2.1/servers/e1382e00-fe71-4915-b4d8-0669cce4072d => generated 1368 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:31:00.690968 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-0c1b56e8-0773-46b1-99cb-ab220baf0b8a tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512f01cca14b447c8f6c9eebbd828eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70bbccf07e3404cb94ba59201061a6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:31:00.705358 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-0c1b56e8-0773-46b1-99cb-ab220baf0b8a tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] 10.222.0.30 "GET /compute/v2.1/servers/e541a8c3-c14c-46db-8b18-23fff07aa1d2" status: 200 len: 1521 microversion: 2.1 time: 1.439122 Jun 16 18:31:00.713632 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 134/259] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:30:59 2022] GET /compute/v2.1/servers/e541a8c3-c14c-46db-8b18-23fff07aa1d2 => generated 1521 bytes in 1450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:31:00.806680 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-eff34011-334c-45ca-a3ef-e6a76ff1e932 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:31:00.807432 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-eff34011-334c-45ca-a3ef-e6a76ff1e932 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] [instance: 651b5fe1-0df7-4bc6-b18e-7caea544a93f] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:31:00.819521 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-eff34011-334c-45ca-a3ef-e6a76ff1e932 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:00.820790 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-eff34011-334c-45ca-a3ef-e6a76ff1e932 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:00.826502 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-eff34011-334c-45ca-a3ef-e6a76ff1e932 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:00.829090 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-eff34011-334c-45ca-a3ef-e6a76ff1e932 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:01.251974 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-7d34b0a1-df45-4820-8f80-08c3002568c5 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:31:01.253247 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-7d34b0a1-df45-4820-8f80-08c3002568c5 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] [instance: e1382e00-fe71-4915-b4d8-0669cce4072d] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:31:01.299033 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-7d34b0a1-df45-4820-8f80-08c3002568c5 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:01.304112 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-7d34b0a1-df45-4820-8f80-08c3002568c5 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:01.306486 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-7d34b0a1-df45-4820-8f80-08c3002568c5 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:01.330811 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-7d34b0a1-df45-4820-8f80-08c3002568c5 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:02.007980 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-eff34011-334c-45ca-a3ef-e6a76ff1e932 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:31:02.041480 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-eff34011-334c-45ca-a3ef-e6a76ff1e932 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:31:02.045325 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-eff34011-334c-45ca-a3ef-e6a76ff1e932 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:31:02.053922 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-eff34011-334c-45ca-a3ef-e6a76ff1e932 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] 10.222.0.30 "GET /compute/v2.1/servers/651b5fe1-0df7-4bc6-b18e-7caea544a93f" status: 200 len: 1724 microversion: 2.20 time: 1.251785 Jun 16 18:31:02.068041 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 126/260] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Jun 16 18:31:00 2022] GET /compute/v2.1/servers/651b5fe1-0df7-4bc6-b18e-7caea544a93f => generated 1724 bytes in 1267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:31:02.097385 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-ebe533a8-9961-4985-8b03-f5849b7e0b93 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:31:02.099122 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-ebe533a8-9961-4985-8b03-f5849b7e0b93 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] [instance: e541a8c3-c14c-46db-8b18-23fff07aa1d2] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:31:02.121134 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-ebe533a8-9961-4985-8b03-f5849b7e0b93 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:02.122743 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-ebe533a8-9961-4985-8b03-f5849b7e0b93 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:02.134661 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-ebe533a8-9961-4985-8b03-f5849b7e0b93 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:02.136320 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-ebe533a8-9961-4985-8b03-f5849b7e0b93 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:02.299546 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG dbcounter [-] [117671] Writing DB stats nova_cell0:SELECT=2 {{(pid=117671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:31:02.579070 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-7d34b0a1-df45-4820-8f80-08c3002568c5 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f6c755dbf74640a372802f02733eb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f0473c6214a4428be438fabc530012b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:31:02.591339 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-7d34b0a1-df45-4820-8f80-08c3002568c5 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] 10.222.0.30 "GET /compute/v2.1/servers/e1382e00-fe71-4915-b4d8-0669cce4072d" status: 200 len: 1368 microversion: 2.1 time: 1.353720 Jun 16 18:31:02.596672 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 135/261] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:31:01 2022] GET /compute/v2.1/servers/e1382e00-fe71-4915-b4d8-0669cce4072d => generated 1368 bytes in 1360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:31:02.621645 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [req-3cab1bd6-e938-4b0e-b77c-b489d6a281e1 req-5bb5ba39-85b5-4947-ab78-01aae569c3e4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e1382e00-fe71-4915-b4d8-0669cce4072d", "tag": "561647b3-5ae8-4d31-9f4a-ca1106d4478e"}]} {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:31:02.654103 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [req-3cab1bd6-e938-4b0e-b77c-b489d6a281e1 req-5bb5ba39-85b5-4947-ab78-01aae569c3e4 service nova] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:02.654452 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [req-3cab1bd6-e938-4b0e-b77c-b489d6a281e1 req-5bb5ba39-85b5-4947-ab78-01aae569c3e4 service nova] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:02.718153 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-ebe533a8-9961-4985-8b03-f5849b7e0b93 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512f01cca14b447c8f6c9eebbd828eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70bbccf07e3404cb94ba59201061a6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:31:02.720707 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.compute.server_external_events [req-3cab1bd6-e938-4b0e-b77c-b489d6a281e1 req-5bb5ba39-85b5-4947-ab78-01aae569c3e4 service nova] Creating event network-changed:561647b3-5ae8-4d31-9f4a-ca1106d4478e for instance e1382e00-fe71-4915-b4d8-0669cce4072d on hv-cinder-81322 Jun 16 18:31:02.747200 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-ebe533a8-9961-4985-8b03-f5849b7e0b93 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] 10.222.0.30 "GET /compute/v2.1/servers/e541a8c3-c14c-46db-8b18-23fff07aa1d2" status: 200 len: 1521 microversion: 2.1 time: 0.673949 Jun 16 18:31:02.749341 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [req-3cab1bd6-e938-4b0e-b77c-b489d6a281e1 req-5bb5ba39-85b5-4947-ab78-01aae569c3e4 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.150716 Jun 16 18:31:02.757553 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 136/262] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Jun 16 18:31:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:31:02.762226 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 127/263] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:31:02 2022] GET /compute/v2.1/servers/e541a8c3-c14c-46db-8b18-23fff07aa1d2 => generated 1521 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:31:03.092988 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-b6cb1d60-74d4-47ac-b428-1fbcff37b68b tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:31:03.097274 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-b6cb1d60-74d4-47ac-b428-1fbcff37b68b tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] [instance: 651b5fe1-0df7-4bc6-b18e-7caea544a93f] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:31:03.126355 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-b6cb1d60-74d4-47ac-b428-1fbcff37b68b tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:03.127335 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-b6cb1d60-74d4-47ac-b428-1fbcff37b68b tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:03.132737 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-b6cb1d60-74d4-47ac-b428-1fbcff37b68b tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:03.136844 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-b6cb1d60-74d4-47ac-b428-1fbcff37b68b tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:03.481980 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-b6cb1d60-74d4-47ac-b428-1fbcff37b68b tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:31:03.514425 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-b6cb1d60-74d4-47ac-b428-1fbcff37b68b tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:31:03.526788 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-b6cb1d60-74d4-47ac-b428-1fbcff37b68b tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:31:03.528576 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-b6cb1d60-74d4-47ac-b428-1fbcff37b68b tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] 10.222.0.30 "GET /compute/v2.1/servers/651b5fe1-0df7-4bc6-b18e-7caea544a93f" status: 200 len: 1724 microversion: 2.20 time: 0.445888 Jun 16 18:31:03.549665 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 137/264] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Jun 16 18:31:03 2022] GET /compute/v2.1/servers/651b5fe1-0df7-4bc6-b18e-7caea544a93f => generated 1724 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:31:03.618966 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-2d1da5b7-76ef-457c-b72f-5d3f3d201145 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:31:03.621563 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-2d1da5b7-76ef-457c-b72f-5d3f3d201145 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] [instance: e1382e00-fe71-4915-b4d8-0669cce4072d] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:31:03.636917 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-2d1da5b7-76ef-457c-b72f-5d3f3d201145 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:03.639790 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-2d1da5b7-76ef-457c-b72f-5d3f3d201145 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:03.642135 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-2d1da5b7-76ef-457c-b72f-5d3f3d201145 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:03.642945 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-2d1da5b7-76ef-457c-b72f-5d3f3d201145 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:03.784029 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-3d915791-55d3-468b-9f68-f7cb3c465fab tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:31:03.785392 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-3d915791-55d3-468b-9f68-f7cb3c465fab tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] [instance: e541a8c3-c14c-46db-8b18-23fff07aa1d2] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:31:03.795934 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG dbcounter [-] [117670] Writing DB stats nova_api:SELECT=34 {{(pid=117670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:31:03.812836 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-3d915791-55d3-468b-9f68-f7cb3c465fab tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:03.814157 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-3d915791-55d3-468b-9f68-f7cb3c465fab tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:03.816201 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-3d915791-55d3-468b-9f68-f7cb3c465fab tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:03.817348 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-3d915791-55d3-468b-9f68-f7cb3c465fab tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:04.107041 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-2d1da5b7-76ef-457c-b72f-5d3f3d201145 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f6c755dbf74640a372802f02733eb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f0473c6214a4428be438fabc530012b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:31:04.123002 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-2d1da5b7-76ef-457c-b72f-5d3f3d201145 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] 10.222.0.30 "GET /compute/v2.1/servers/e1382e00-fe71-4915-b4d8-0669cce4072d" status: 200 len: 1368 microversion: 2.1 time: 0.502571 Jun 16 18:31:04.127302 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 128/265] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:31:03 2022] GET /compute/v2.1/servers/e1382e00-fe71-4915-b4d8-0669cce4072d => generated 1368 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:31:04.441153 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-3d915791-55d3-468b-9f68-f7cb3c465fab tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512f01cca14b447c8f6c9eebbd828eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70bbccf07e3404cb94ba59201061a6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:31:04.467869 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-3d915791-55d3-468b-9f68-f7cb3c465fab tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] 10.222.0.30 "GET /compute/v2.1/servers/e541a8c3-c14c-46db-8b18-23fff07aa1d2" status: 200 len: 1521 microversion: 2.1 time: 0.700693 Jun 16 18:31:04.471533 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 138/266] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:31:03 2022] GET /compute/v2.1/servers/e541a8c3-c14c-46db-8b18-23fff07aa1d2 => generated 1521 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:31:04.556691 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG dbcounter [-] [117671] Writing DB stats nova_cell0:SELECT=14 {{(pid=117671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:31:04.567773 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-65ca59db-b333-477c-8d0d-17a8e88e34ff tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:31:04.569341 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-65ca59db-b333-477c-8d0d-17a8e88e34ff tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] [instance: 651b5fe1-0df7-4bc6-b18e-7caea544a93f] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:31:04.588553 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-65ca59db-b333-477c-8d0d-17a8e88e34ff tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:04.591502 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-65ca59db-b333-477c-8d0d-17a8e88e34ff tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:04.593455 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-65ca59db-b333-477c-8d0d-17a8e88e34ff tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:04.594698 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-65ca59db-b333-477c-8d0d-17a8e88e34ff tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:05.145929 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-c7d3dd80-7705-4900-94be-527c33d71dde tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:31:05.147057 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-c7d3dd80-7705-4900-94be-527c33d71dde tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] [instance: e1382e00-fe71-4915-b4d8-0669cce4072d] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:31:05.164186 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-c7d3dd80-7705-4900-94be-527c33d71dde tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:05.167254 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-c7d3dd80-7705-4900-94be-527c33d71dde tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:05.171007 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-c7d3dd80-7705-4900-94be-527c33d71dde tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:05.172255 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-c7d3dd80-7705-4900-94be-527c33d71dde tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:05.279365 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-65ca59db-b333-477c-8d0d-17a8e88e34ff tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:31:05.324643 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-65ca59db-b333-477c-8d0d-17a8e88e34ff tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:31:05.335126 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-65ca59db-b333-477c-8d0d-17a8e88e34ff tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:31:05.349710 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-65ca59db-b333-477c-8d0d-17a8e88e34ff tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] 10.222.0.30 "GET /compute/v2.1/servers/651b5fe1-0df7-4bc6-b18e-7caea544a93f" status: 200 len: 1724 microversion: 2.20 time: 0.784310 Jun 16 18:31:05.350293 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 129/267] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Jun 16 18:31:04 2022] GET /compute/v2.1/servers/651b5fe1-0df7-4bc6-b18e-7caea544a93f => generated 1724 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:31:05.502325 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-cca39e90-33a0-4a8a-8a54-5f120930d7d2 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:31:05.503088 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-cca39e90-33a0-4a8a-8a54-5f120930d7d2 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] [instance: e541a8c3-c14c-46db-8b18-23fff07aa1d2] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:31:05.505138 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG dbcounter [-] [117671] Writing DB stats nova_api:SELECT=62,nova_api:INSERT=4 {{(pid=117671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:31:05.537184 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-cca39e90-33a0-4a8a-8a54-5f120930d7d2 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:05.547719 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-cca39e90-33a0-4a8a-8a54-5f120930d7d2 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:05.548540 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-cca39e90-33a0-4a8a-8a54-5f120930d7d2 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:05.548991 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-cca39e90-33a0-4a8a-8a54-5f120930d7d2 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:05.550824 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-c7d3dd80-7705-4900-94be-527c33d71dde tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f6c755dbf74640a372802f02733eb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f0473c6214a4428be438fabc530012b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:31:05.574968 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG dbcounter [-] [117671] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=117671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:31:05.582656 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-c7d3dd80-7705-4900-94be-527c33d71dde tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] 10.222.0.30 "GET /compute/v2.1/servers/e1382e00-fe71-4915-b4d8-0669cce4072d" status: 200 len: 1368 microversion: 2.1 time: 0.443967 Jun 16 18:31:05.590803 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 139/268] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:31:05 2022] GET /compute/v2.1/servers/e1382e00-fe71-4915-b4d8-0669cce4072d => generated 1368 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:31:05.897564 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-cca39e90-33a0-4a8a-8a54-5f120930d7d2 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512f01cca14b447c8f6c9eebbd828eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70bbccf07e3404cb94ba59201061a6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:31:05.912621 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-cca39e90-33a0-4a8a-8a54-5f120930d7d2 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] 10.222.0.30 "GET /compute/v2.1/servers/e541a8c3-c14c-46db-8b18-23fff07aa1d2" status: 200 len: 1521 microversion: 2.1 time: 0.414937 Jun 16 18:31:05.927587 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 130/269] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:31:05 2022] GET /compute/v2.1/servers/e541a8c3-c14c-46db-8b18-23fff07aa1d2 => generated 1521 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:31:06.371537 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-14e6de39-5ae0-4dc9-8ca7-e71154ca6701 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:31:06.373076 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-14e6de39-5ae0-4dc9-8ca7-e71154ca6701 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] [instance: 651b5fe1-0df7-4bc6-b18e-7caea544a93f] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:31:06.396450 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-14e6de39-5ae0-4dc9-8ca7-e71154ca6701 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:06.396976 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-14e6de39-5ae0-4dc9-8ca7-e71154ca6701 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:06.397824 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-14e6de39-5ae0-4dc9-8ca7-e71154ca6701 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:06.398893 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-14e6de39-5ae0-4dc9-8ca7-e71154ca6701 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:06.617878 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-ba89f644-87a7-48bc-b353-4cb206ec5fa9 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:31:06.619943 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-ba89f644-87a7-48bc-b353-4cb206ec5fa9 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] [instance: e1382e00-fe71-4915-b4d8-0669cce4072d] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:31:06.634374 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-ba89f644-87a7-48bc-b353-4cb206ec5fa9 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:06.640336 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-ba89f644-87a7-48bc-b353-4cb206ec5fa9 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:06.641558 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-ba89f644-87a7-48bc-b353-4cb206ec5fa9 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:06.644473 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-ba89f644-87a7-48bc-b353-4cb206ec5fa9 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:06.896379 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-14e6de39-5ae0-4dc9-8ca7-e71154ca6701 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:31:06.907739 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-14e6de39-5ae0-4dc9-8ca7-e71154ca6701 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:31:06.910525 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-14e6de39-5ae0-4dc9-8ca7-e71154ca6701 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:31:06.911979 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-14e6de39-5ae0-4dc9-8ca7-e71154ca6701 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] 10.222.0.30 "GET /compute/v2.1/servers/651b5fe1-0df7-4bc6-b18e-7caea544a93f" status: 200 len: 1724 microversion: 2.20 time: 0.546801 Jun 16 18:31:06.924937 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 140/270] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Jun 16 18:31:06 2022] GET /compute/v2.1/servers/651b5fe1-0df7-4bc6-b18e-7caea544a93f => generated 1724 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:31:06.932014 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-0428f3a0-51a1-4bbd-a1f2-51f524c54f96 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:31:06.932980 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-0428f3a0-51a1-4bbd-a1f2-51f524c54f96 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] [instance: e541a8c3-c14c-46db-8b18-23fff07aa1d2] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:31:06.939664 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-0428f3a0-51a1-4bbd-a1f2-51f524c54f96 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:06.940232 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-0428f3a0-51a1-4bbd-a1f2-51f524c54f96 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:06.940936 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-0428f3a0-51a1-4bbd-a1f2-51f524c54f96 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:06.941437 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-0428f3a0-51a1-4bbd-a1f2-51f524c54f96 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:07.110764 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-ba89f644-87a7-48bc-b353-4cb206ec5fa9 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f6c755dbf74640a372802f02733eb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f0473c6214a4428be438fabc530012b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:31:07.122135 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-ba89f644-87a7-48bc-b353-4cb206ec5fa9 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] 10.222.0.30 "GET /compute/v2.1/servers/e1382e00-fe71-4915-b4d8-0669cce4072d" status: 200 len: 1368 microversion: 2.1 time: 0.508807 Jun 16 18:31:07.123424 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 131/271] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:31:06 2022] GET /compute/v2.1/servers/e1382e00-fe71-4915-b4d8-0669cce4072d => generated 1368 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:31:07.419973 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-0428f3a0-51a1-4bbd-a1f2-51f524c54f96 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512f01cca14b447c8f6c9eebbd828eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70bbccf07e3404cb94ba59201061a6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:31:07.428562 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-0428f3a0-51a1-4bbd-a1f2-51f524c54f96 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] 10.222.0.30 "GET /compute/v2.1/servers/e541a8c3-c14c-46db-8b18-23fff07aa1d2" status: 200 len: 1501 microversion: 2.1 time: 0.500948 Jun 16 18:31:07.429466 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 141/272] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:31:06 2022] GET /compute/v2.1/servers/e541a8c3-c14c-46db-8b18-23fff07aa1d2 => generated 1501 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:31:07.459171 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-67b1c856-f317-44f4-8bd5-005de88fa579 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "aec44dec-7a2a-4bdd-a586-c35f969835c3"}} {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:31:07.460416 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-67b1c856-f317-44f4-8bd5-005de88fa579 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] [instance: e541a8c3-c14c-46db-8b18-23fff07aa1d2] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:31:07.467745 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-67b1c856-f317-44f4-8bd5-005de88fa579 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:07.468235 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-67b1c856-f317-44f4-8bd5-005de88fa579 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:07.469062 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-67b1c856-f317-44f4-8bd5-005de88fa579 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:07.469506 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-67b1c856-f317-44f4-8bd5-005de88fa579 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:07.548804 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.wsgi [None req-67b1c856-f317-44f4-8bd5-005de88fa579 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] HTTP exception thrown: Cannot 'attach_volume' instance e541a8c3-c14c-46db-8b18-23fff07aa1d2 while it is in vm_state rescued Jun 16 18:31:07.554747 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-67b1c856-f317-44f4-8bd5-005de88fa579 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Request method failure captured: Jun 16 18:31:07.554747 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: request: POST /compute/v2.1/servers/e541a8c3-c14c-46db-8b18-23fff07aa1d2/os-volume_attachments HTTP/1.1 Jun 16 18:31:07.554747 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: Accept: application/json Jun 16 18:31:07.554747 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: Accept-Encoding: identity Jun 16 18:31:07.554747 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: Connection: close Jun 16 18:31:07.554747 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: Content-Length: 74 Jun 16 18:31:07.554747 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: Content-Type: application/json Jun 16 18:31:07.554747 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: Host: 10.222.0.30 Jun 16 18:31:07.554747 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: Openstack-System-Scope: None Jun 16 18:31:07.554747 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: User-Agent: python-urllib3/1.26.9 Jun 16 18:31:07.554747 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Auth-Token: gAAAAABiq3ZeOWVXrcHoFQenWS7gEz2AmLT0pk9WALQKP9rY-D8or65AIFivXjSOMGuT5nkfTCPX-UgC2J78DfMkn6N1K-iY82TmKX61g47gNVuWG9jlnvzIzdHnPvexbz1CwR9za6ZIAFnBpf6Y_L3GTnzg7Lzmn3ZLTYDBiHKMrCwhKJPoGQI Jun 16 18:31:07.554747 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Domain-Id: None Jun 16 18:31:07.554747 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Domain-Name: None Jun 16 18:31:07.554747 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Identity-Status: Confirmed Jun 16 18:31:07.554747 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Is-Admin-Project: True Jun 16 18:31:07.554747 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Project-Domain-Id: default Jun 16 18:31:07.554747 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Project-Domain-Name: Default Jun 16 18:31:07.554747 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Project-Id: b70bbccf07e3404cb94ba59201061a6a Jun 16 18:31:07.554747 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1891572618 Jun 16 18:31:07.554747 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Role: reader,member Jun 16 18:31:07.554747 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Roles: reader,member Jun 16 18:31:07.557541 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/b70bbccf07e3404cb94ba59201061a6a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/b70bbccf07e3404cb94ba59201061a6a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_b70bbccf07e3404cb94ba59201061a6a", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/b70bbccf07e3404cb94ba59201061a6a"}]}] Jun 16 18:31:07.557541 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1891572618 Jun 16 18:31:07.557541 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Tenant-Id: b70bbccf07e3404cb94ba59201061a6a Jun 16 18:31:07.557541 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1891572618 Jun 16 18:31:07.557541 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-User: tempest-ServerRescueNegativeTestJSON-1891572618-project Jun 16 18:31:07.557541 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-User-Domain-Id: default Jun 16 18:31:07.557541 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-User-Domain-Name: Default Jun 16 18:31:07.557541 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-User-Id: 512f01cca14b447c8f6c9eebbd828eb2 Jun 16 18:31:07.557541 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1891572618-project Jun 16 18:31:07.557541 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: Jun 16 18:31:07.557541 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: {"volumeAttachment": {"volumeId": "aec44dec-7a2a-4bdd-a586-c35f969835c3"}} Jun 16 18:31:07.557541 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: method: > Jun 16 18:31:07.559194 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: exception: Cannot 'attach_volume' instance e541a8c3-c14c-46db-8b18-23fff07aa1d2 while it is in vm_state rescued Jun 16 18:31:07.559194 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: action_args: {'server_id': 'e541a8c3-c14c-46db-8b18-23fff07aa1d2', 'body': {'volumeAttachment': {'volumeId': 'aec44dec-7a2a-4bdd-a586-c35f969835c3'}}} Jun 16 18:31:07.559194 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:31:07.559194 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:31:07.559194 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 16 18:31:07.559194 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 16 18:31:07.559194 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 16 18:31:07.559194 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 16 18:31:07.559194 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 16 18:31:07.559194 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 16 18:31:07.559194 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance e541a8c3-c14c-46db-8b18-23fff07aa1d2 in vm_state rescued. Cannot attach_volume while the instance is in this state. Jun 16 18:31:07.559194 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Jun 16 18:31:07.559194 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:31:07.559194 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Jun 16 18:31:07.559194 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:31:07.559194 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:31:07.559194 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:31:07.559194 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:31:07.559194 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:31:07.561756 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:31:07.561756 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:31:07.561756 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 18:31:07.561756 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 18:31:07.561756 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 18:31:07.561756 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 18:31:07.561756 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 18:31:07.561756 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 18:31:07.561756 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jun 16 18:31:07.561756 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 16 18:31:07.561756 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 16 18:31:07.561756 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 16 18:31:07.561756 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance e541a8c3-c14c-46db-8b18-23fff07aa1d2 while it is in vm_state rescued Jun 16 18:31:07.561756 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Jun 16 18:31:07.561756 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:31:07.561756 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Jun 16 18:31:07.561756 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:31:07.561756 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:31:07.561756 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:31:07.564238 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:31:07.564238 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:31:07.564238 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance e541a8c3-c14c-46db-8b18-23fff07aa1d2 while it is in vm_state rescued Jun 16 18:31:07.564238 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Jun 16 18:31:07.571719 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-67b1c856-f317-44f4-8bd5-005de88fa579 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Returning 409 to user: Cannot 'attach_volume' instance e541a8c3-c14c-46db-8b18-23fff07aa1d2 while it is in vm_state rescued {{(pid=117671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:31:07.574045 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-67b1c856-f317-44f4-8bd5-005de88fa579 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] 10.222.0.30 "POST /compute/v2.1/servers/e541a8c3-c14c-46db-8b18-23fff07aa1d2/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.118886 Jun 16 18:31:07.588839 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-7563276c-1a55-46fc-869a-07db37302157 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:31:07.589780 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-7563276c-1a55-46fc-869a-07db37302157 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] [instance: e541a8c3-c14c-46db-8b18-23fff07aa1d2] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:31:07.593093 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 132/273] 10.222.0.30 () {60 vars in 1322 bytes} [Thu Jun 16 18:31:07 2022] POST /compute/v2.1/servers/e541a8c3-c14c-46db-8b18-23fff07aa1d2/os-volume_attachments => generated 152 bytes in 134 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 16 18:31:07.615128 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-7563276c-1a55-46fc-869a-07db37302157 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:07.616206 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-7563276c-1a55-46fc-869a-07db37302157 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:07.617933 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-7563276c-1a55-46fc-869a-07db37302157 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:07.618961 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-7563276c-1a55-46fc-869a-07db37302157 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:07.786285 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-7563276c-1a55-46fc-869a-07db37302157 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] 10.222.0.30 "POST /compute/v2.1/servers/e541a8c3-c14c-46db-8b18-23fff07aa1d2/action" status: 202 len: 0 microversion: 2.1 time: 0.205325 Jun 16 18:31:07.790688 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 142/274] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Jun 16 18:31:07 2022] POST /compute/v2.1/servers/e541a8c3-c14c-46db-8b18-23fff07aa1d2/action => generated 0 bytes in 211 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 18:31:07.797631 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-0e672aaf-a067-4d89-be8f-85d1459470aa tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:31:07.799063 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-0e672aaf-a067-4d89-be8f-85d1459470aa tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] [instance: e541a8c3-c14c-46db-8b18-23fff07aa1d2] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:31:07.810101 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-0e672aaf-a067-4d89-be8f-85d1459470aa tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:07.811545 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-0e672aaf-a067-4d89-be8f-85d1459470aa tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:07.812721 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-0e672aaf-a067-4d89-be8f-85d1459470aa tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:07.813415 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-0e672aaf-a067-4d89-be8f-85d1459470aa tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:07.932595 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-b5eeda83-bc7e-4516-9ced-9b6ccc2e082b tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:31:07.933324 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-b5eeda83-bc7e-4516-9ced-9b6ccc2e082b tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] [instance: 651b5fe1-0df7-4bc6-b18e-7caea544a93f] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:31:07.945812 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-b5eeda83-bc7e-4516-9ced-9b6ccc2e082b tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:07.946603 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-b5eeda83-bc7e-4516-9ced-9b6ccc2e082b tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:07.950832 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-b5eeda83-bc7e-4516-9ced-9b6ccc2e082b tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:07.951287 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-b5eeda83-bc7e-4516-9ced-9b6ccc2e082b tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:08.230547 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-0e672aaf-a067-4d89-be8f-85d1459470aa tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512f01cca14b447c8f6c9eebbd828eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70bbccf07e3404cb94ba59201061a6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:31:08.240791 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-0e672aaf-a067-4d89-be8f-85d1459470aa tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] 10.222.0.30 "GET /compute/v2.1/servers/e541a8c3-c14c-46db-8b18-23fff07aa1d2" status: 200 len: 1509 microversion: 2.1 time: 0.448327 Jun 16 18:31:08.241572 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 133/275] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:31:07 2022] GET /compute/v2.1/servers/e541a8c3-c14c-46db-8b18-23fff07aa1d2 => generated 1509 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:31:08.247277 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-7ae1cfcc-e8e3-4385-926f-5155560022ee tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:31:08.248080 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-7ae1cfcc-e8e3-4385-926f-5155560022ee tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] [instance: e1382e00-fe71-4915-b4d8-0669cce4072d] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:31:08.256164 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-7ae1cfcc-e8e3-4385-926f-5155560022ee tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:08.257016 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-7ae1cfcc-e8e3-4385-926f-5155560022ee tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:08.258147 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-7ae1cfcc-e8e3-4385-926f-5155560022ee tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:08.258871 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-7ae1cfcc-e8e3-4385-926f-5155560022ee tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:08.543173 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-7ae1cfcc-e8e3-4385-926f-5155560022ee tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f6c755dbf74640a372802f02733eb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f0473c6214a4428be438fabc530012b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:31:08.559076 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-7ae1cfcc-e8e3-4385-926f-5155560022ee tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] 10.222.0.30 "GET /compute/v2.1/servers/e1382e00-fe71-4915-b4d8-0669cce4072d" status: 200 len: 1368 microversion: 2.1 time: 0.316142 Jun 16 18:31:08.559678 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 134/276] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:31:08 2022] GET /compute/v2.1/servers/e1382e00-fe71-4915-b4d8-0669cce4072d => generated 1368 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:31:08.573777 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-03f1ab1e-458e-4235-becb-1896ebde5b8a tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Action: 'create', calling method: .version_select at 0x7fbb301019d0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1502264594", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKiWSHgKIlghWKe8nM0Gw4gOXHQM6flKA8CJWncT53KlxtCWmZLvJi+Fb9F6s2j+fNlB90mxOsl91d+ofq60GK6HO3ET020LiM46HTpGWVsaiLXsHgB3EprTQIk6RV5EeA=="}} {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:31:08.605910 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.quota [None req-03f1ab1e-458e-4235-becb-1896ebde5b8a tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Getting quotas for project c9fa2caa1412451aa0308c807d5c62d8. Resources: {'key_pairs'} {{(pid=117671) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 18:31:08.619041 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.quota [None req-03f1ab1e-458e-4235-becb-1896ebde5b8a tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Getting quotas for user 0d7d57c4231b49b28a606a17e42267e7 and project c9fa2caa1412451aa0308c807d5c62d8. Resources: {'key_pairs'} {{(pid=117671) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 18:31:08.682419 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-03f1ab1e-458e-4235-becb-1896ebde5b8a tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.120432 Jun 16 18:31:08.691515 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 135/277] 10.222.0.30 () {60 vars in 1158 bytes} [Thu Jun 16 18:31:08 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:31:08.970847 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-b5eeda83-bc7e-4516-9ced-9b6ccc2e082b tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:31:08.996924 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-b5eeda83-bc7e-4516-9ced-9b6ccc2e082b tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:31:09.000123 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-b5eeda83-bc7e-4516-9ced-9b6ccc2e082b tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:31:09.002831 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-b5eeda83-bc7e-4516-9ced-9b6ccc2e082b tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] 10.222.0.30 "GET /compute/v2.1/servers/651b5fe1-0df7-4bc6-b18e-7caea544a93f" status: 200 len: 1724 microversion: 2.20 time: 1.075382 Jun 16 18:31:09.015033 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 143/278] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Jun 16 18:31:07 2022] GET /compute/v2.1/servers/651b5fe1-0df7-4bc6-b18e-7caea544a93f => generated 1724 bytes in 1078 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:31:09.043125 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-1d94ba99-1162-4f15-8f5d-28ba2412280c tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1220417071", "imageRef": "d75732dc-a8e8-405c-abd5-2d34fd640211", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1502264594", "networks": [{"uuid": "27d95e4b-ad96-4962-a7f7-edebeb2e07d8"}]}} {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:31:09.136231 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.network.neutron [None req-1d94ba99-1162-4f15-8f5d-28ba2412280c tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] validate_networks() for [('27d95e4b-ad96-4962-a7f7-edebeb2e07d8', None, None, None, None, None)] {{(pid=117671) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 18:31:09.284204 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-5dda9486-4cf2-49fe-bf1f-701f0f4a2314 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:31:09.285333 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-5dda9486-4cf2-49fe-bf1f-701f0f4a2314 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] [instance: e541a8c3-c14c-46db-8b18-23fff07aa1d2] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:31:09.299929 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-5dda9486-4cf2-49fe-bf1f-701f0f4a2314 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:09.302565 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-5dda9486-4cf2-49fe-bf1f-701f0f4a2314 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:09.305093 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-5dda9486-4cf2-49fe-bf1f-701f0f4a2314 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:09.306440 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-5dda9486-4cf2-49fe-bf1f-701f0f4a2314 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:09.821247 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-5dda9486-4cf2-49fe-bf1f-701f0f4a2314 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512f01cca14b447c8f6c9eebbd828eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70bbccf07e3404cb94ba59201061a6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:31:09.877344 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-5dda9486-4cf2-49fe-bf1f-701f0f4a2314 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] 10.222.0.30 "GET /compute/v2.1/servers/e541a8c3-c14c-46db-8b18-23fff07aa1d2" status: 200 len: 1509 microversion: 2.1 time: 0.598400 Jun 16 18:31:09.878674 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 144/279] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:31:09 2022] GET /compute/v2.1/servers/e541a8c3-c14c-46db-8b18-23fff07aa1d2 => generated 1509 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:31:09.902628 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-24852026-cf15-4396-bfaf-21b83876695d tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:31:09.902628 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-24852026-cf15-4396-bfaf-21b83876695d tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] [instance: e1382e00-fe71-4915-b4d8-0669cce4072d] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:31:09.921273 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-24852026-cf15-4396-bfaf-21b83876695d tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:09.921981 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-24852026-cf15-4396-bfaf-21b83876695d tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:09.922990 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-24852026-cf15-4396-bfaf-21b83876695d tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:09.923593 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-24852026-cf15-4396-bfaf-21b83876695d tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:10.248583 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-24852026-cf15-4396-bfaf-21b83876695d tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f6c755dbf74640a372802f02733eb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f0473c6214a4428be438fabc530012b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:31:10.272523 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-24852026-cf15-4396-bfaf-21b83876695d tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] 10.222.0.30 "GET /compute/v2.1/servers/e1382e00-fe71-4915-b4d8-0669cce4072d" status: 200 len: 1368 microversion: 2.1 time: 0.383109 Jun 16 18:31:10.274502 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 145/280] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:31:09 2022] GET /compute/v2.1/servers/e1382e00-fe71-4915-b4d8-0669cce4072d => generated 1368 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:31:10.298464 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-706874a9-f98a-4264-8f37-8779bb21bf47 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:31:10.300221 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-706874a9-f98a-4264-8f37-8779bb21bf47 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] [instance: 651b5fe1-0df7-4bc6-b18e-7caea544a93f] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:31:10.317330 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-706874a9-f98a-4264-8f37-8779bb21bf47 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:10.318728 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-706874a9-f98a-4264-8f37-8779bb21bf47 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:10.320426 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-706874a9-f98a-4264-8f37-8779bb21bf47 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:10.322065 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-706874a9-f98a-4264-8f37-8779bb21bf47 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:10.356706 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.virt.hardware [None req-1d94ba99-1162-4f15-8f5d-28ba2412280c tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Flavor limits 0:0:0 {{(pid=117671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 18:31:10.360942 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.virt.hardware [None req-1d94ba99-1162-4f15-8f5d-28ba2412280c tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Image limits 0:0:0 {{(pid=117671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 18:31:10.362452 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.virt.hardware [None req-1d94ba99-1162-4f15-8f5d-28ba2412280c tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Flavor pref 0:0:0 {{(pid=117671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 18:31:10.363881 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.virt.hardware [None req-1d94ba99-1162-4f15-8f5d-28ba2412280c tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Image pref 0:0:0 {{(pid=117671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 18:31:10.364891 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.virt.hardware [None req-1d94ba99-1162-4f15-8f5d-28ba2412280c tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 18:31:10.397702 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-1d94ba99-1162-4f15-8f5d-28ba2412280c tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:10.399153 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-1d94ba99-1162-4f15-8f5d-28ba2412280c tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:10.401719 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-1d94ba99-1162-4f15-8f5d-28ba2412280c tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:10.403138 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-1d94ba99-1162-4f15-8f5d-28ba2412280c tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:10.470905 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.quota [None req-1d94ba99-1162-4f15-8f5d-28ba2412280c tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Getting quotas for project c9fa2caa1412451aa0308c807d5c62d8. Resources: {'instances', 'ram', 'cores'} {{(pid=117671) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 18:31:10.483346 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.quota [None req-1d94ba99-1162-4f15-8f5d-28ba2412280c tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Getting quotas for user 0d7d57c4231b49b28a606a17e42267e7 and project c9fa2caa1412451aa0308c807d5c62d8. Resources: {'instances', 'ram', 'cores'} {{(pid=117671) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 18:31:10.518979 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-1d94ba99-1162-4f15-8f5d-28ba2412280c tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Going to run 1 instances... {{(pid=117671) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 18:31:10.526292 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-1d94ba99-1162-4f15-8f5d-28ba2412280c tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] [instance: 26fdb428-7e41-4e0f-b91a-15009844089f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d75732dc-a8e8-405c-abd5-2d34fd640211',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117671) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 18:31:10.600546 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-1d94ba99-1162-4f15-8f5d-28ba2412280c tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.564910 Jun 16 18:31:10.607875 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 136/281] 10.222.0.30 () {60 vars in 1146 bytes} [Thu Jun 16 18:31:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 1573 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 16 18:31:10.614283 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-961e86a6-99b8-4747-b187-7d613f086970 tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:31:10.615281 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-961e86a6-99b8-4747-b187-7d613f086970 tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] [instance: 26fdb428-7e41-4e0f-b91a-15009844089f] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:31:10.731628 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-961e86a6-99b8-4747-b187-7d613f086970 tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7d57c4231b49b28a606a17e42267e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9fa2caa1412451aa0308c807d5c62d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:31:10.747571 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-961e86a6-99b8-4747-b187-7d613f086970 tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] 10.222.0.30 "GET /compute/v2.1/servers/26fdb428-7e41-4e0f-b91a-15009844089f" status: 200 len: 1259 microversion: 2.1 time: 0.131003 Jun 16 18:31:10.747571 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 137/282] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:31:10 2022] GET /compute/v2.1/servers/26fdb428-7e41-4e0f-b91a-15009844089f => generated 1259 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:31:10.792441 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-706874a9-f98a-4264-8f37-8779bb21bf47 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:31:10.824282 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-706874a9-f98a-4264-8f37-8779bb21bf47 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:31:10.828681 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-706874a9-f98a-4264-8f37-8779bb21bf47 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:31:10.832847 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-706874a9-f98a-4264-8f37-8779bb21bf47 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] 10.222.0.30 "GET /compute/v2.1/servers/651b5fe1-0df7-4bc6-b18e-7caea544a93f" status: 200 len: 1745 microversion: 2.20 time: 0.555884 Jun 16 18:31:10.834360 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 146/283] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Jun 16 18:31:10 2022] GET /compute/v2.1/servers/651b5fe1-0df7-4bc6-b18e-7caea544a93f => generated 1745 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:31:10.873824 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [req-2bcc26db-616e-42eb-8124-aa47fb3a03f4 req-481ae51d-00ea-41bb-a5d8-a2f900bea19d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1382e00-fe71-4915-b4d8-0669cce4072d", "name": "network-vif-plugged", "status": "completed", "tag": "561647b3-5ae8-4d31-9f4a-ca1106d4478e"}]} {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:31:10.895763 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [req-2bcc26db-616e-42eb-8124-aa47fb3a03f4 req-481ae51d-00ea-41bb-a5d8-a2f900bea19d service nova] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:10.896369 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [req-2bcc26db-616e-42eb-8124-aa47fb3a03f4 req-481ae51d-00ea-41bb-a5d8-a2f900bea19d service nova] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:10.917619 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-b9aab30e-057f-4e01-8530-1052d9070ef7 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:31:10.920210 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-b9aab30e-057f-4e01-8530-1052d9070ef7 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] [instance: e541a8c3-c14c-46db-8b18-23fff07aa1d2] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:31:10.936313 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-b9aab30e-057f-4e01-8530-1052d9070ef7 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:10.937483 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-b9aab30e-057f-4e01-8530-1052d9070ef7 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:10.939373 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-b9aab30e-057f-4e01-8530-1052d9070ef7 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:10.939969 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.compute.server_external_events [req-2bcc26db-616e-42eb-8124-aa47fb3a03f4 req-481ae51d-00ea-41bb-a5d8-a2f900bea19d service nova] Creating event network-vif-plugged:561647b3-5ae8-4d31-9f4a-ca1106d4478e for instance e1382e00-fe71-4915-b4d8-0669cce4072d on hv-cinder-81322 Jun 16 18:31:10.943266 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-b9aab30e-057f-4e01-8530-1052d9070ef7 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:10.978984 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [req-2bcc26db-616e-42eb-8124-aa47fb3a03f4 req-481ae51d-00ea-41bb-a5d8-a2f900bea19d service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100945 Jun 16 18:31:10.982310 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 138/284] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Jun 16 18:31:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:31:11.304477 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-7ff150f7-3d8b-4bcd-bdf2-6424729d5673 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:31:11.314412 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-7ff150f7-3d8b-4bcd-bdf2-6424729d5673 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] [instance: e1382e00-fe71-4915-b4d8-0669cce4072d] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:31:11.342981 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-7ff150f7-3d8b-4bcd-bdf2-6424729d5673 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:11.343439 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-7ff150f7-3d8b-4bcd-bdf2-6424729d5673 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:11.348891 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-7ff150f7-3d8b-4bcd-bdf2-6424729d5673 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:11.348891 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-7ff150f7-3d8b-4bcd-bdf2-6424729d5673 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:11.425922 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-b9aab30e-057f-4e01-8530-1052d9070ef7 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512f01cca14b447c8f6c9eebbd828eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70bbccf07e3404cb94ba59201061a6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:31:11.439951 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-b9aab30e-057f-4e01-8530-1052d9070ef7 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] 10.222.0.30 "GET /compute/v2.1/servers/e541a8c3-c14c-46db-8b18-23fff07aa1d2" status: 200 len: 1509 microversion: 2.1 time: 0.532806 Jun 16 18:31:11.452565 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 147/285] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:31:10 2022] GET /compute/v2.1/servers/e541a8c3-c14c-46db-8b18-23fff07aa1d2 => generated 1509 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:31:11.764400 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-e58a6a3f-1b45-4be2-a896-82bf50691b9b tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:31:11.765988 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-e58a6a3f-1b45-4be2-a896-82bf50691b9b tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] [instance: 26fdb428-7e41-4e0f-b91a-15009844089f] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:31:11.875934 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-7ff150f7-3d8b-4bcd-bdf2-6424729d5673 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f6c755dbf74640a372802f02733eb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f0473c6214a4428be438fabc530012b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:31:11.903634 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-7ff150f7-3d8b-4bcd-bdf2-6424729d5673 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] 10.222.0.30 "GET /compute/v2.1/servers/e1382e00-fe71-4915-b4d8-0669cce4072d" status: 200 len: 1368 microversion: 2.1 time: 0.608944 Jun 16 18:31:11.905607 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 139/286] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:31:11 2022] GET /compute/v2.1/servers/e1382e00-fe71-4915-b4d8-0669cce4072d => generated 1368 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:31:11.922287 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-9424097b-4610-4933-9cd9-cede9b14263f tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:31:11.923388 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-9424097b-4610-4933-9cd9-cede9b14263f tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] [instance: 651b5fe1-0df7-4bc6-b18e-7caea544a93f] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:31:11.938943 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-9424097b-4610-4933-9cd9-cede9b14263f tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:11.939916 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-9424097b-4610-4933-9cd9-cede9b14263f tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:11.941401 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-9424097b-4610-4933-9cd9-cede9b14263f tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:11.942525 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-9424097b-4610-4933-9cd9-cede9b14263f tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:11.954961 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-e58a6a3f-1b45-4be2-a896-82bf50691b9b tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7d57c4231b49b28a606a17e42267e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9fa2caa1412451aa0308c807d5c62d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:31:11.970103 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-e58a6a3f-1b45-4be2-a896-82bf50691b9b tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] 10.222.0.30 "GET /compute/v2.1/servers/26fdb428-7e41-4e0f-b91a-15009844089f" status: 200 len: 1259 microversion: 2.1 time: 0.214568 Jun 16 18:31:11.972103 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 148/287] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:31:11 2022] GET /compute/v2.1/servers/26fdb428-7e41-4e0f-b91a-15009844089f => generated 1259 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:31:12.142453 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-9424097b-4610-4933-9cd9-cede9b14263f tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:31:12.155451 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-9424097b-4610-4933-9cd9-cede9b14263f tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:31:12.159719 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-9424097b-4610-4933-9cd9-cede9b14263f tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:31:12.167296 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-9424097b-4610-4933-9cd9-cede9b14263f tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] 10.222.0.30 "GET /compute/v2.1/servers/651b5fe1-0df7-4bc6-b18e-7caea544a93f" status: 200 len: 1740 microversion: 2.20 time: 0.256995 Jun 16 18:31:12.169160 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 140/288] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Jun 16 18:31:11 2022] GET /compute/v2.1/servers/651b5fe1-0df7-4bc6-b18e-7caea544a93f => generated 1740 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:31:12.468940 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-0673c179-68c8-4bb1-94df-d3fd4560f58b tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:31:12.470883 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-0673c179-68c8-4bb1-94df-d3fd4560f58b tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] [instance: e541a8c3-c14c-46db-8b18-23fff07aa1d2] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:31:12.525478 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-0673c179-68c8-4bb1-94df-d3fd4560f58b tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:12.526240 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-0673c179-68c8-4bb1-94df-d3fd4560f58b tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:12.527646 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-0673c179-68c8-4bb1-94df-d3fd4560f58b tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:12.528474 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-0673c179-68c8-4bb1-94df-d3fd4560f58b tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:12.941358 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-a9b090bf-77ab-4685-8db8-b794ebaa9f50 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:31:12.950530 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-a9b090bf-77ab-4685-8db8-b794ebaa9f50 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] [instance: e1382e00-fe71-4915-b4d8-0669cce4072d] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:31:12.989693 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-a9b090bf-77ab-4685-8db8-b794ebaa9f50 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:12.990660 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-a9b090bf-77ab-4685-8db8-b794ebaa9f50 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:12.994118 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-a9b090bf-77ab-4685-8db8-b794ebaa9f50 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:12.994947 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-a9b090bf-77ab-4685-8db8-b794ebaa9f50 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:13.121919 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-0673c179-68c8-4bb1-94df-d3fd4560f58b tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512f01cca14b447c8f6c9eebbd828eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70bbccf07e3404cb94ba59201061a6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:31:13.143372 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-0673c179-68c8-4bb1-94df-d3fd4560f58b tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] 10.222.0.30 "GET /compute/v2.1/servers/e541a8c3-c14c-46db-8b18-23fff07aa1d2" status: 200 len: 1509 microversion: 2.1 time: 0.681504 Jun 16 18:31:13.145552 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 149/289] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:31:12 2022] GET /compute/v2.1/servers/e541a8c3-c14c-46db-8b18-23fff07aa1d2 => generated 1509 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:31:13.157028 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-14b73f23-9b82-4ba1-9692-6074b3593132 tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:31:13.158968 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-14b73f23-9b82-4ba1-9692-6074b3593132 tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] [instance: 26fdb428-7e41-4e0f-b91a-15009844089f] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:31:13.176292 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-14b73f23-9b82-4ba1-9692-6074b3593132 tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:13.177390 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-14b73f23-9b82-4ba1-9692-6074b3593132 tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:13.178987 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-14b73f23-9b82-4ba1-9692-6074b3593132 tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:13.180961 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-14b73f23-9b82-4ba1-9692-6074b3593132 tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:13.230655 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG dbcounter [-] [117670] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:31:13.282247 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-a9b090bf-77ab-4685-8db8-b794ebaa9f50 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f6c755dbf74640a372802f02733eb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f0473c6214a4428be438fabc530012b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:31:13.292597 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-a9b090bf-77ab-4685-8db8-b794ebaa9f50 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] 10.222.0.30 "GET /compute/v2.1/servers/e1382e00-fe71-4915-b4d8-0669cce4072d" status: 200 len: 1368 microversion: 2.1 time: 0.364715 Jun 16 18:31:13.293545 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 141/290] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:31:12 2022] GET /compute/v2.1/servers/e1382e00-fe71-4915-b4d8-0669cce4072d => generated 1368 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:31:13.302438 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [req-6483fc79-4972-455e-8127-bc4166f63373 req-c8f90ef0-2d9a-4937-ba2d-c4313b483bc7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "651b5fe1-0df7-4bc6-b18e-7caea544a93f", "name": "network-vif-plugged", "status": "completed", "tag": "7416c7c3-1e79-4777-a950-c0c27847ca8e"}]} {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:31:13.320354 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [req-6483fc79-4972-455e-8127-bc4166f63373 req-c8f90ef0-2d9a-4937-ba2d-c4313b483bc7 service nova] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:13.322046 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [req-6483fc79-4972-455e-8127-bc4166f63373 req-c8f90ef0-2d9a-4937-ba2d-c4313b483bc7 service nova] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:13.347264 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.compute.server_external_events [req-6483fc79-4972-455e-8127-bc4166f63373 req-c8f90ef0-2d9a-4937-ba2d-c4313b483bc7 service nova] Creating event network-vif-plugged:7416c7c3-1e79-4777-a950-c0c27847ca8e for instance 651b5fe1-0df7-4bc6-b18e-7caea544a93f on hv-cinder-81322 Jun 16 18:31:13.357549 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [req-6483fc79-4972-455e-8127-bc4166f63373 req-c8f90ef0-2d9a-4937-ba2d-c4313b483bc7 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060738 Jun 16 18:31:13.358129 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 142/291] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Jun 16 18:31:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:31:13.370978 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-204a7a66-52d7-4300-95c7-a7f25e1b978f tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:31:13.371978 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-204a7a66-52d7-4300-95c7-a7f25e1b978f tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] [instance: 651b5fe1-0df7-4bc6-b18e-7caea544a93f] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:31:13.384857 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-204a7a66-52d7-4300-95c7-a7f25e1b978f tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:13.387082 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-204a7a66-52d7-4300-95c7-a7f25e1b978f tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:13.388297 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-204a7a66-52d7-4300-95c7-a7f25e1b978f tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:13.388751 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-204a7a66-52d7-4300-95c7-a7f25e1b978f tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:13.403225 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-14b73f23-9b82-4ba1-9692-6074b3593132 tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7d57c4231b49b28a606a17e42267e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9fa2caa1412451aa0308c807d5c62d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:31:13.414476 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-14b73f23-9b82-4ba1-9692-6074b3593132 tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] 10.222.0.30 "GET /compute/v2.1/servers/26fdb428-7e41-4e0f-b91a-15009844089f" status: 200 len: 1311 microversion: 2.1 time: 0.267211 Jun 16 18:31:13.415736 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 150/292] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:31:13 2022] GET /compute/v2.1/servers/26fdb428-7e41-4e0f-b91a-15009844089f => generated 1311 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:31:13.667028 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-204a7a66-52d7-4300-95c7-a7f25e1b978f tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:31:13.686021 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-204a7a66-52d7-4300-95c7-a7f25e1b978f tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:31:13.691120 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-204a7a66-52d7-4300-95c7-a7f25e1b978f tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:31:13.695633 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-204a7a66-52d7-4300-95c7-a7f25e1b978f tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] 10.222.0.30 "GET /compute/v2.1/servers/651b5fe1-0df7-4bc6-b18e-7caea544a93f" status: 200 len: 1740 microversion: 2.20 time: 0.330862 Jun 16 18:31:13.697495 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 143/293] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Jun 16 18:31:13 2022] GET /compute/v2.1/servers/651b5fe1-0df7-4bc6-b18e-7caea544a93f => generated 1740 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:31:14.175646 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-a98863d7-15c5-463c-b742-e9b6372494af tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:31:14.180363 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-a98863d7-15c5-463c-b742-e9b6372494af tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] [instance: e541a8c3-c14c-46db-8b18-23fff07aa1d2] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:31:14.204802 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-a98863d7-15c5-463c-b742-e9b6372494af tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:14.205299 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-a98863d7-15c5-463c-b742-e9b6372494af tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:14.206463 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-a98863d7-15c5-463c-b742-e9b6372494af tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:14.207009 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-a98863d7-15c5-463c-b742-e9b6372494af tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:14.340453 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-6486dfbd-71e0-4b25-9e26-d9b2e6332357 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:31:14.341978 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-6486dfbd-71e0-4b25-9e26-d9b2e6332357 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] [instance: e1382e00-fe71-4915-b4d8-0669cce4072d] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:31:14.380824 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-6486dfbd-71e0-4b25-9e26-d9b2e6332357 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:14.381832 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-6486dfbd-71e0-4b25-9e26-d9b2e6332357 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:14.388823 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-6486dfbd-71e0-4b25-9e26-d9b2e6332357 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:14.396384 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-6486dfbd-71e0-4b25-9e26-d9b2e6332357 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:14.498947 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-a98863d7-15c5-463c-b742-e9b6372494af tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512f01cca14b447c8f6c9eebbd828eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70bbccf07e3404cb94ba59201061a6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:31:14.513230 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-a98863d7-15c5-463c-b742-e9b6372494af tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] 10.222.0.30 "GET /compute/v2.1/servers/e541a8c3-c14c-46db-8b18-23fff07aa1d2" status: 200 len: 1515 microversion: 2.1 time: 0.345245 Jun 16 18:31:14.530218 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 151/294] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:31:14 2022] GET /compute/v2.1/servers/e541a8c3-c14c-46db-8b18-23fff07aa1d2 => generated 1515 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:31:14.544883 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-e56eeecc-9b14-402b-944c-982d09fe3e63 tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:31:14.546524 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-e56eeecc-9b14-402b-944c-982d09fe3e63 tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] [instance: 26fdb428-7e41-4e0f-b91a-15009844089f] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:31:14.565436 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-e56eeecc-9b14-402b-944c-982d09fe3e63 tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:14.566700 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-e56eeecc-9b14-402b-944c-982d09fe3e63 tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:14.568582 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-e56eeecc-9b14-402b-944c-982d09fe3e63 tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:14.570178 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-e56eeecc-9b14-402b-944c-982d09fe3e63 tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:14.719224 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-e56eeecc-9b14-402b-944c-982d09fe3e63 tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7d57c4231b49b28a606a17e42267e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9fa2caa1412451aa0308c807d5c62d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:31:14.730990 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-e56eeecc-9b14-402b-944c-982d09fe3e63 tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] 10.222.0.30 "GET /compute/v2.1/servers/26fdb428-7e41-4e0f-b91a-15009844089f" status: 200 len: 1311 microversion: 2.1 time: 0.198385 Jun 16 18:31:14.731577 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 152/295] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:31:14 2022] GET /compute/v2.1/servers/26fdb428-7e41-4e0f-b91a-15009844089f => generated 1311 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:31:14.740950 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-c7666945-db2b-4027-9e1a-8e6167efadc3 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:31:14.741672 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-c7666945-db2b-4027-9e1a-8e6167efadc3 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] [instance: 651b5fe1-0df7-4bc6-b18e-7caea544a93f] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:31:14.749264 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-c7666945-db2b-4027-9e1a-8e6167efadc3 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:14.749718 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-c7666945-db2b-4027-9e1a-8e6167efadc3 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:14.750742 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-c7666945-db2b-4027-9e1a-8e6167efadc3 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:14.751190 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-c7666945-db2b-4027-9e1a-8e6167efadc3 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:14.754785 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-6486dfbd-71e0-4b25-9e26-d9b2e6332357 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f6c755dbf74640a372802f02733eb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f0473c6214a4428be438fabc530012b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:31:14.769715 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-6486dfbd-71e0-4b25-9e26-d9b2e6332357 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] 10.222.0.30 "GET /compute/v2.1/servers/e1382e00-fe71-4915-b4d8-0669cce4072d" status: 200 len: 1368 microversion: 2.1 time: 0.449850 Jun 16 18:31:14.775974 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 144/296] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:31:14 2022] GET /compute/v2.1/servers/e1382e00-fe71-4915-b4d8-0669cce4072d => generated 1368 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:31:14.964660 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-c7666945-db2b-4027-9e1a-8e6167efadc3 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:31:14.975397 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-c7666945-db2b-4027-9e1a-8e6167efadc3 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:31:14.979296 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-c7666945-db2b-4027-9e1a-8e6167efadc3 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:31:14.980999 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-c7666945-db2b-4027-9e1a-8e6167efadc3 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] 10.222.0.30 "GET /compute/v2.1/servers/651b5fe1-0df7-4bc6-b18e-7caea544a93f" status: 200 len: 1740 microversion: 2.20 time: 0.244776 Jun 16 18:31:14.982212 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 153/297] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Jun 16 18:31:14 2022] GET /compute/v2.1/servers/651b5fe1-0df7-4bc6-b18e-7caea544a93f => generated 1740 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:31:15.755534 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-7a989fc0-1334-4d24-bbbd-f2e07aa3aa83 tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:31:15.756908 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-7a989fc0-1334-4d24-bbbd-f2e07aa3aa83 tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] [instance: 26fdb428-7e41-4e0f-b91a-15009844089f] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:31:15.765580 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-7a989fc0-1334-4d24-bbbd-f2e07aa3aa83 tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:15.766389 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-7a989fc0-1334-4d24-bbbd-f2e07aa3aa83 tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:15.767265 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-7a989fc0-1334-4d24-bbbd-f2e07aa3aa83 tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:15.767774 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-7a989fc0-1334-4d24-bbbd-f2e07aa3aa83 tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:15.803185 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-300b5277-d795-4037-bdf2-162da7cc5a7f tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:31:15.804138 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-300b5277-d795-4037-bdf2-162da7cc5a7f tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] [instance: e1382e00-fe71-4915-b4d8-0669cce4072d] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:31:15.818152 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-300b5277-d795-4037-bdf2-162da7cc5a7f tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:15.819092 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-300b5277-d795-4037-bdf2-162da7cc5a7f tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:15.819950 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-300b5277-d795-4037-bdf2-162da7cc5a7f tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:15.829909 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-300b5277-d795-4037-bdf2-162da7cc5a7f tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:15.895161 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-7a989fc0-1334-4d24-bbbd-f2e07aa3aa83 tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7d57c4231b49b28a606a17e42267e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9fa2caa1412451aa0308c807d5c62d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:31:15.917065 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-7a989fc0-1334-4d24-bbbd-f2e07aa3aa83 tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] 10.222.0.30 "GET /compute/v2.1/servers/26fdb428-7e41-4e0f-b91a-15009844089f" status: 200 len: 1311 microversion: 2.1 time: 0.171207 Jun 16 18:31:15.919917 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 145/298] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:31:15 2022] GET /compute/v2.1/servers/26fdb428-7e41-4e0f-b91a-15009844089f => generated 1311 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:31:16.030254 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-84e4df00-7dfd-4c99-919f-3b2db0116174 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:31:16.031752 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-84e4df00-7dfd-4c99-919f-3b2db0116174 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] [instance: 651b5fe1-0df7-4bc6-b18e-7caea544a93f] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:31:16.049588 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-84e4df00-7dfd-4c99-919f-3b2db0116174 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:16.050693 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-84e4df00-7dfd-4c99-919f-3b2db0116174 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:16.052411 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-84e4df00-7dfd-4c99-919f-3b2db0116174 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:16.053456 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-84e4df00-7dfd-4c99-919f-3b2db0116174 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:16.364860 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-300b5277-d795-4037-bdf2-162da7cc5a7f tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f6c755dbf74640a372802f02733eb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f0473c6214a4428be438fabc530012b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:31:16.386190 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-300b5277-d795-4037-bdf2-162da7cc5a7f tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] 10.222.0.30 "GET /compute/v2.1/servers/e1382e00-fe71-4915-b4d8-0669cce4072d" status: 200 len: 1368 microversion: 2.1 time: 0.587775 Jun 16 18:31:16.386804 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 154/299] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:31:15 2022] GET /compute/v2.1/servers/e1382e00-fe71-4915-b4d8-0669cce4072d => generated 1368 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:31:16.482727 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-84e4df00-7dfd-4c99-919f-3b2db0116174 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:31:16.532815 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-84e4df00-7dfd-4c99-919f-3b2db0116174 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:31:16.534228 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-84e4df00-7dfd-4c99-919f-3b2db0116174 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:31:16.537381 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-84e4df00-7dfd-4c99-919f-3b2db0116174 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] 10.222.0.30 "GET /compute/v2.1/servers/651b5fe1-0df7-4bc6-b18e-7caea544a93f" status: 200 len: 1740 microversion: 2.20 time: 0.527505 Jun 16 18:31:16.539519 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 146/300] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Jun 16 18:31:16 2022] GET /compute/v2.1/servers/651b5fe1-0df7-4bc6-b18e-7caea544a93f => generated 1740 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:31:16.962621 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-21ac32b7-b3b7-4e93-a493-c3a6ae80c74a tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:31:16.963686 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-21ac32b7-b3b7-4e93-a493-c3a6ae80c74a tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] [instance: 26fdb428-7e41-4e0f-b91a-15009844089f] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:31:16.982403 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-21ac32b7-b3b7-4e93-a493-c3a6ae80c74a tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:16.983133 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-21ac32b7-b3b7-4e93-a493-c3a6ae80c74a tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:16.984376 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-21ac32b7-b3b7-4e93-a493-c3a6ae80c74a tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:16.985573 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-21ac32b7-b3b7-4e93-a493-c3a6ae80c74a tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:17.136851 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-21ac32b7-b3b7-4e93-a493-c3a6ae80c74a tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7d57c4231b49b28a606a17e42267e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9fa2caa1412451aa0308c807d5c62d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:31:17.150877 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-21ac32b7-b3b7-4e93-a493-c3a6ae80c74a tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] 10.222.0.30 "GET /compute/v2.1/servers/26fdb428-7e41-4e0f-b91a-15009844089f" status: 200 len: 1317 microversion: 2.1 time: 0.201641 Jun 16 18:31:17.151822 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 155/301] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:31:16 2022] GET /compute/v2.1/servers/26fdb428-7e41-4e0f-b91a-15009844089f => generated 1317 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:31:17.403087 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-23b7893f-55c5-4649-8917-72af510310be tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Action: 'create', calling method: .version_select at 0x7fbb23f880d0>, body: {"keypair": {"name": "tempest-keypair-1111354642", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDHwubGUIpQG1t+5cZs3AtKn32iJooFHyJOCY/e2IDrJmVncg148xJzaDiqbiW+Y7hB1V/t3YhwOPBuIspK5XtpGQA61BtwkxzzlL5XdP3N1/qorRqh59skvA7xGxqvTDQ=="}} {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:31:17.418360 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-ec5ed34a-e6c2-422a-be42-d0d5121bc301 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:31:17.419796 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-ec5ed34a-e6c2-422a-be42-d0d5121bc301 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] [instance: e1382e00-fe71-4915-b4d8-0669cce4072d] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:31:17.428671 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-ec5ed34a-e6c2-422a-be42-d0d5121bc301 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:17.429781 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-ec5ed34a-e6c2-422a-be42-d0d5121bc301 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:17.431424 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-ec5ed34a-e6c2-422a-be42-d0d5121bc301 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:17.432166 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-ec5ed34a-e6c2-422a-be42-d0d5121bc301 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:17.434276 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.quota [None req-23b7893f-55c5-4649-8917-72af510310be tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Getting quotas for project b70bbccf07e3404cb94ba59201061a6a. Resources: {'key_pairs'} {{(pid=117671) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 18:31:17.443459 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.quota [None req-23b7893f-55c5-4649-8917-72af510310be tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Getting quotas for user 512f01cca14b447c8f6c9eebbd828eb2 and project b70bbccf07e3404cb94ba59201061a6a. Resources: {'key_pairs'} {{(pid=117671) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 18:31:17.490106 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-23b7893f-55c5-4649-8917-72af510310be tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.094953 Jun 16 18:31:17.496017 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 147/302] 10.222.0.30 () {60 vars in 1158 bytes} [Thu Jun 16 18:31:17 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:31:17.564374 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-bcad1954-9cb6-46ee-ab23-e7d098be7d4e tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:31:17.570855 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-bcad1954-9cb6-46ee-ab23-e7d098be7d4e tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] [instance: 651b5fe1-0df7-4bc6-b18e-7caea544a93f] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:31:17.604271 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-bcad1954-9cb6-46ee-ab23-e7d098be7d4e tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:17.605137 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-bcad1954-9cb6-46ee-ab23-e7d098be7d4e tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:17.606541 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-bcad1954-9cb6-46ee-ab23-e7d098be7d4e tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:17.607319 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-bcad1954-9cb6-46ee-ab23-e7d098be7d4e tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:17.807529 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-ec5ed34a-e6c2-422a-be42-d0d5121bc301 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f6c755dbf74640a372802f02733eb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f0473c6214a4428be438fabc530012b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:31:17.817709 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-ec5ed34a-e6c2-422a-be42-d0d5121bc301 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] 10.222.0.30 "GET /compute/v2.1/servers/e1382e00-fe71-4915-b4d8-0669cce4072d" status: 200 len: 1368 microversion: 2.1 time: 0.405749 Jun 16 18:31:17.819712 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 156/303] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:31:17 2022] GET /compute/v2.1/servers/e1382e00-fe71-4915-b4d8-0669cce4072d => generated 1368 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:31:17.963275 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-bcad1954-9cb6-46ee-ab23-e7d098be7d4e tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:31:17.983597 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-bcad1954-9cb6-46ee-ab23-e7d098be7d4e tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:31:17.988996 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-bcad1954-9cb6-46ee-ab23-e7d098be7d4e tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:31:17.990878 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-bcad1954-9cb6-46ee-ab23-e7d098be7d4e tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] 10.222.0.30 "GET /compute/v2.1/servers/651b5fe1-0df7-4bc6-b18e-7caea544a93f" status: 200 len: 1740 microversion: 2.20 time: 0.434827 Jun 16 18:31:17.996899 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 148/304] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Jun 16 18:31:17 2022] GET /compute/v2.1/servers/651b5fe1-0df7-4bc6-b18e-7caea544a93f => generated 1740 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 18:31:18.173586 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-1c8fde07-fcd2-4c5b-9066-1f5c11ce0892 tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:31:18.175334 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-1c8fde07-fcd2-4c5b-9066-1f5c11ce0892 tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] [instance: 26fdb428-7e41-4e0f-b91a-15009844089f] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:31:18.188834 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-1c8fde07-fcd2-4c5b-9066-1f5c11ce0892 tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:18.189935 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-1c8fde07-fcd2-4c5b-9066-1f5c11ce0892 tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:18.191346 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-1c8fde07-fcd2-4c5b-9066-1f5c11ce0892 tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:18.192316 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-1c8fde07-fcd2-4c5b-9066-1f5c11ce0892 tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:18.361237 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-1c8fde07-fcd2-4c5b-9066-1f5c11ce0892 tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7d57c4231b49b28a606a17e42267e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9fa2caa1412451aa0308c807d5c62d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:31:18.377110 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-1c8fde07-fcd2-4c5b-9066-1f5c11ce0892 tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] 10.222.0.30 "GET /compute/v2.1/servers/26fdb428-7e41-4e0f-b91a-15009844089f" status: 200 len: 1317 microversion: 2.1 time: 0.209970 Jun 16 18:31:18.393044 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 157/305] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:31:18 2022] GET /compute/v2.1/servers/26fdb428-7e41-4e0f-b91a-15009844089f => generated 1317 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:31:18.863573 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-258202f9-0cc1-4ecf-b93e-b3602760e4a7 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:31:18.865715 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-258202f9-0cc1-4ecf-b93e-b3602760e4a7 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] [instance: e1382e00-fe71-4915-b4d8-0669cce4072d] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:31:18.885098 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-258202f9-0cc1-4ecf-b93e-b3602760e4a7 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:18.886672 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-258202f9-0cc1-4ecf-b93e-b3602760e4a7 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:18.889053 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-258202f9-0cc1-4ecf-b93e-b3602760e4a7 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:18.889772 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-258202f9-0cc1-4ecf-b93e-b3602760e4a7 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:19.036705 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-ae30f859-1565-4f7c-ab46-2022ba5f1524 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:31:19.042543 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-ae30f859-1565-4f7c-ab46-2022ba5f1524 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] [instance: 651b5fe1-0df7-4bc6-b18e-7caea544a93f] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:31:19.066009 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-ae30f859-1565-4f7c-ab46-2022ba5f1524 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:19.066806 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-ae30f859-1565-4f7c-ab46-2022ba5f1524 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:19.080088 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-ae30f859-1565-4f7c-ab46-2022ba5f1524 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:19.081956 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-ae30f859-1565-4f7c-ab46-2022ba5f1524 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:19.333988 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-ae30f859-1565-4f7c-ab46-2022ba5f1524 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:31:19.343723 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-ae30f859-1565-4f7c-ab46-2022ba5f1524 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:31:19.347419 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-ae30f859-1565-4f7c-ab46-2022ba5f1524 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:31:19.349862 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-ae30f859-1565-4f7c-ab46-2022ba5f1524 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] 10.222.0.30 "GET /compute/v2.1/servers/651b5fe1-0df7-4bc6-b18e-7caea544a93f" status: 200 len: 1740 microversion: 2.20 time: 0.329576 Jun 16 18:31:19.362215 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 158/306] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Jun 16 18:31:19 2022] GET /compute/v2.1/servers/651b5fe1-0df7-4bc6-b18e-7caea544a93f => generated 1740 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:31:19.403207 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-b4decc88-b1cb-4259-bb58-080bb2ea2387 tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:31:19.404548 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-b4decc88-b1cb-4259-bb58-080bb2ea2387 tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] [instance: 26fdb428-7e41-4e0f-b91a-15009844089f] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:31:19.411571 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-b4decc88-b1cb-4259-bb58-080bb2ea2387 tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:19.412714 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-b4decc88-b1cb-4259-bb58-080bb2ea2387 tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:19.413761 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-b4decc88-b1cb-4259-bb58-080bb2ea2387 tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:19.415203 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-b4decc88-b1cb-4259-bb58-080bb2ea2387 tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:19.542534 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-b4decc88-b1cb-4259-bb58-080bb2ea2387 tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7d57c4231b49b28a606a17e42267e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9fa2caa1412451aa0308c807d5c62d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:31:19.561549 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-b4decc88-b1cb-4259-bb58-080bb2ea2387 tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] 10.222.0.30 "GET /compute/v2.1/servers/26fdb428-7e41-4e0f-b91a-15009844089f" status: 200 len: 1317 microversion: 2.1 time: 0.162684 Jun 16 18:31:19.563745 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 159/307] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:31:19 2022] GET /compute/v2.1/servers/26fdb428-7e41-4e0f-b91a-15009844089f => generated 1317 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:31:19.726587 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-258202f9-0cc1-4ecf-b93e-b3602760e4a7 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f6c755dbf74640a372802f02733eb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f0473c6214a4428be438fabc530012b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:31:19.746338 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-258202f9-0cc1-4ecf-b93e-b3602760e4a7 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] 10.222.0.30 "GET /compute/v2.1/servers/e1382e00-fe71-4915-b4d8-0669cce4072d" status: 200 len: 1368 microversion: 2.1 time: 0.903147 Jun 16 18:31:19.747617 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 149/308] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:31:18 2022] GET /compute/v2.1/servers/e1382e00-fe71-4915-b4d8-0669cce4072d => generated 1368 bytes in 906 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:31:20.375258 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-29bad14b-d859-4546-9415-bca092c31933 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:31:20.387535 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-29bad14b-d859-4546-9415-bca092c31933 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] [instance: 651b5fe1-0df7-4bc6-b18e-7caea544a93f] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:31:20.437672 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-29bad14b-d859-4546-9415-bca092c31933 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:20.438727 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-29bad14b-d859-4546-9415-bca092c31933 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:20.447802 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-29bad14b-d859-4546-9415-bca092c31933 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:20.448683 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-29bad14b-d859-4546-9415-bca092c31933 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:20.589242 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-0ca93bee-255f-4ae0-a279-baa958652115 tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:31:20.593868 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-0ca93bee-255f-4ae0-a279-baa958652115 tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] [instance: 26fdb428-7e41-4e0f-b91a-15009844089f] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:31:20.605575 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG dbcounter [-] [117671] Writing DB stats nova_cell0:SELECT=2 {{(pid=117671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:31:20.630847 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-0ca93bee-255f-4ae0-a279-baa958652115 tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:20.635060 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-0ca93bee-255f-4ae0-a279-baa958652115 tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:20.642257 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-0ca93bee-255f-4ae0-a279-baa958652115 tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:20.643751 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-0ca93bee-255f-4ae0-a279-baa958652115 tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:21.088377 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-0ca93bee-255f-4ae0-a279-baa958652115 tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7d57c4231b49b28a606a17e42267e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9fa2caa1412451aa0308c807d5c62d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:31:21.153386 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-0ca93bee-255f-4ae0-a279-baa958652115 tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] 10.222.0.30 "GET /compute/v2.1/servers/26fdb428-7e41-4e0f-b91a-15009844089f" status: 200 len: 1317 microversion: 2.1 time: 0.572155 Jun 16 18:31:21.154025 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 150/309] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:31:20 2022] GET /compute/v2.1/servers/26fdb428-7e41-4e0f-b91a-15009844089f => generated 1317 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:31:21.185890 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-fa0f5fc7-b3c3-4f20-8d97-1a1002309538 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:31:21.186524 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-fa0f5fc7-b3c3-4f20-8d97-1a1002309538 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] [instance: e1382e00-fe71-4915-b4d8-0669cce4072d] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:31:21.217821 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-fa0f5fc7-b3c3-4f20-8d97-1a1002309538 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:21.229181 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-fa0f5fc7-b3c3-4f20-8d97-1a1002309538 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:21.230495 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-fa0f5fc7-b3c3-4f20-8d97-1a1002309538 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:21.235450 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-fa0f5fc7-b3c3-4f20-8d97-1a1002309538 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:21.296348 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-29bad14b-d859-4546-9415-bca092c31933 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:31:21.393303 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-29bad14b-d859-4546-9415-bca092c31933 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:31:21.407182 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-29bad14b-d859-4546-9415-bca092c31933 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:31:21.419647 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-29bad14b-d859-4546-9415-bca092c31933 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] 10.222.0.30 "GET /compute/v2.1/servers/651b5fe1-0df7-4bc6-b18e-7caea544a93f" status: 200 len: 1740 microversion: 2.20 time: 1.050574 Jun 16 18:31:21.425195 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 160/310] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Jun 16 18:31:20 2022] GET /compute/v2.1/servers/651b5fe1-0df7-4bc6-b18e-7caea544a93f => generated 1740 bytes in 1059 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:31:21.735534 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-fa0f5fc7-b3c3-4f20-8d97-1a1002309538 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f6c755dbf74640a372802f02733eb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f0473c6214a4428be438fabc530012b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:31:21.751242 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-fa0f5fc7-b3c3-4f20-8d97-1a1002309538 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] 10.222.0.30 "GET /compute/v2.1/servers/e1382e00-fe71-4915-b4d8-0669cce4072d" status: 200 len: 1557 microversion: 2.1 time: 0.592494 Jun 16 18:31:21.751842 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 151/311] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:31:21 2022] GET /compute/v2.1/servers/e1382e00-fe71-4915-b4d8-0669cce4072d => generated 1557 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:31:21.786059 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-e36036d2-0a57-41ac-bf03-2c091fdecfd1 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:31:21.786906 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-e36036d2-0a57-41ac-bf03-2c091fdecfd1 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] [instance: e1382e00-fe71-4915-b4d8-0669cce4072d] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:31:21.821748 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-e36036d2-0a57-41ac-bf03-2c091fdecfd1 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:21.822800 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-e36036d2-0a57-41ac-bf03-2c091fdecfd1 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:21.824145 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-e36036d2-0a57-41ac-bf03-2c091fdecfd1 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:21.827087 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-e36036d2-0a57-41ac-bf03-2c091fdecfd1 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:21.853011 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-ae927dc7-e8d8-41aa-a396-d53bd9a6a854 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1600269584", "imageRef": "38ef083a-a9ff-4836-8954-f770268ba205", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "15279682-d7de-41a6-80bc-29c22a949874"}], "security_groups": [{"name": "tempest-securitygroup--945531727"}], "key_name": "tempest-keypair-1111354642", "user_data": "}} {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:31:21.963690 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG dbcounter [-] [117670] Writing DB stats nova_cell0:SELECT=2 {{(pid=117670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:31:22.034437 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-e36036d2-0a57-41ac-bf03-2c091fdecfd1 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] 10.222.0.30 "GET /compute/v2.1/servers/e1382e00-fe71-4915-b4d8-0669cce4072d/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.256135 Jun 16 18:31:22.040869 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 161/312] 10.222.0.30 () {58 vars in 1274 bytes} [Thu Jun 16 18:31:21 2022] GET /compute/v2.1/servers/e1382e00-fe71-4915-b4d8-0669cce4072d/os-interface => generated 284 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:31:22.186724 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-6c1dd037-dbdd-458c-a26f-508a16f1ff2a tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:31:22.188236 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-6c1dd037-dbdd-458c-a26f-508a16f1ff2a tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] [instance: 26fdb428-7e41-4e0f-b91a-15009844089f] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:31:22.214893 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-6c1dd037-dbdd-458c-a26f-508a16f1ff2a tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:22.226169 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-6c1dd037-dbdd-458c-a26f-508a16f1ff2a tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:22.230180 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-6c1dd037-dbdd-458c-a26f-508a16f1ff2a tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:22.231567 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-6c1dd037-dbdd-458c-a26f-508a16f1ff2a tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:23.085289 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-6c1dd037-dbdd-458c-a26f-508a16f1ff2a tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7d57c4231b49b28a606a17e42267e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9fa2caa1412451aa0308c807d5c62d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:31:23.107816 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-6c1dd037-dbdd-458c-a26f-508a16f1ff2a tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] 10.222.0.30 "GET /compute/v2.1/servers/26fdb428-7e41-4e0f-b91a-15009844089f" status: 200 len: 1359 microversion: 2.1 time: 0.927327 Jun 16 18:31:23.113607 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 162/313] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:31:22 2022] GET /compute/v2.1/servers/26fdb428-7e41-4e0f-b91a-15009844089f => generated 1359 bytes in 932 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:31:23.127146 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-d1615264-d9fb-476d-aafc-51b33f6a677e tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:31:23.130108 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-d1615264-d9fb-476d-aafc-51b33f6a677e tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] [instance: 651b5fe1-0df7-4bc6-b18e-7caea544a93f] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:31:23.150622 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-d1615264-d9fb-476d-aafc-51b33f6a677e tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:23.153342 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-d1615264-d9fb-476d-aafc-51b33f6a677e tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:23.154550 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-d1615264-d9fb-476d-aafc-51b33f6a677e tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:23.158642 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-d1615264-d9fb-476d-aafc-51b33f6a677e tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:23.926923 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-d1615264-d9fb-476d-aafc-51b33f6a677e tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:31:23.948405 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-d1615264-d9fb-476d-aafc-51b33f6a677e tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:31:23.951658 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-d1615264-d9fb-476d-aafc-51b33f6a677e tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:31:23.954004 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-d1615264-d9fb-476d-aafc-51b33f6a677e tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] 10.222.0.30 "GET /compute/v2.1/servers/651b5fe1-0df7-4bc6-b18e-7caea544a93f" status: 200 len: 1740 microversion: 2.20 time: 0.836181 Jun 16 18:31:23.955526 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 163/314] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Jun 16 18:31:23 2022] GET /compute/v2.1/servers/651b5fe1-0df7-4bc6-b18e-7caea544a93f => generated 1740 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:31:24.143299 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-45df385c-c097-4368-b941-d4aade24702d tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:31:24.144342 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-45df385c-c097-4368-b941-d4aade24702d tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] [instance: 26fdb428-7e41-4e0f-b91a-15009844089f] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:31:24.166124 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-45df385c-c097-4368-b941-d4aade24702d tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:24.177600 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-45df385c-c097-4368-b941-d4aade24702d tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:24.179353 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-45df385c-c097-4368-b941-d4aade24702d tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:24.187604 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-45df385c-c097-4368-b941-d4aade24702d tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:24.855797 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-45df385c-c097-4368-b941-d4aade24702d tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7d57c4231b49b28a606a17e42267e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9fa2caa1412451aa0308c807d5c62d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:31:24.874994 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-45df385c-c097-4368-b941-d4aade24702d tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] 10.222.0.30 "GET /compute/v2.1/servers/26fdb428-7e41-4e0f-b91a-15009844089f" status: 200 len: 1359 microversion: 2.1 time: 0.735593 Jun 16 18:31:24.875845 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 164/315] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:31:24 2022] GET /compute/v2.1/servers/26fdb428-7e41-4e0f-b91a-15009844089f => generated 1359 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:31:24.975487 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-b71747a0-8e3d-45ae-bf1f-7352146f6c45 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:31:24.976124 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-b71747a0-8e3d-45ae-bf1f-7352146f6c45 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] [instance: 651b5fe1-0df7-4bc6-b18e-7caea544a93f] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:31:24.990747 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-b71747a0-8e3d-45ae-bf1f-7352146f6c45 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:24.998408 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-b71747a0-8e3d-45ae-bf1f-7352146f6c45 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:24.999859 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-b71747a0-8e3d-45ae-bf1f-7352146f6c45 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:25.010126 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-b71747a0-8e3d-45ae-bf1f-7352146f6c45 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:25.350580 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-b71747a0-8e3d-45ae-bf1f-7352146f6c45 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:31:25.363481 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-b71747a0-8e3d-45ae-bf1f-7352146f6c45 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:31:25.375266 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-b71747a0-8e3d-45ae-bf1f-7352146f6c45 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:31:25.382338 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-b71747a0-8e3d-45ae-bf1f-7352146f6c45 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] 10.222.0.30 "GET /compute/v2.1/servers/651b5fe1-0df7-4bc6-b18e-7caea544a93f" status: 200 len: 1740 microversion: 2.20 time: 0.409927 Jun 16 18:31:25.386053 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 165/316] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Jun 16 18:31:24 2022] GET /compute/v2.1/servers/651b5fe1-0df7-4bc6-b18e-7caea544a93f => generated 1740 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:31:25.915792 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-af845f01-b4b8-40f0-a302-8b062e65ffda tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:31:25.939306 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-af845f01-b4b8-40f0-a302-8b062e65ffda tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] [instance: 26fdb428-7e41-4e0f-b91a-15009844089f] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:31:25.953728 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-af845f01-b4b8-40f0-a302-8b062e65ffda tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:25.954503 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-af845f01-b4b8-40f0-a302-8b062e65ffda tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:25.956444 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-af845f01-b4b8-40f0-a302-8b062e65ffda tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:25.958289 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-af845f01-b4b8-40f0-a302-8b062e65ffda tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:26.289344 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-af845f01-b4b8-40f0-a302-8b062e65ffda tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7d57c4231b49b28a606a17e42267e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9fa2caa1412451aa0308c807d5c62d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:31:26.316802 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-af845f01-b4b8-40f0-a302-8b062e65ffda tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] 10.222.0.30 "GET /compute/v2.1/servers/26fdb428-7e41-4e0f-b91a-15009844089f" status: 200 len: 1359 microversion: 2.1 time: 0.414997 Jun 16 18:31:26.334095 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 166/317] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:31:25 2022] GET /compute/v2.1/servers/26fdb428-7e41-4e0f-b91a-15009844089f => generated 1359 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:31:26.378173 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [req-7b40eff7-f124-45ea-9db6-ef91f0b5dc38 req-360e8481-d44e-4cdb-9529-fb31fa1f8411 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e1382e00-fe71-4915-b4d8-0669cce4072d", "tag": "561647b3-5ae8-4d31-9f4a-ca1106d4478e"}]} {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:31:26.431409 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [req-7b40eff7-f124-45ea-9db6-ef91f0b5dc38 req-360e8481-d44e-4cdb-9529-fb31fa1f8411 service nova] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:26.432148 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [req-7b40eff7-f124-45ea-9db6-ef91f0b5dc38 req-360e8481-d44e-4cdb-9529-fb31fa1f8411 service nova] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:26.468375 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.compute.server_external_events [req-7b40eff7-f124-45ea-9db6-ef91f0b5dc38 req-360e8481-d44e-4cdb-9529-fb31fa1f8411 service nova] Creating event network-changed:561647b3-5ae8-4d31-9f4a-ca1106d4478e for instance e1382e00-fe71-4915-b4d8-0669cce4072d on hv-cinder-81322 Jun 16 18:31:26.482901 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [req-7b40eff7-f124-45ea-9db6-ef91f0b5dc38 req-360e8481-d44e-4cdb-9529-fb31fa1f8411 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.146851 Jun 16 18:31:26.483540 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 167/318] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Jun 16 18:31:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:31:26.496373 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [req-31316c6a-93be-45e6-a15e-b62c7c5bd1fc req-b215764e-dc53-4fd7-a48a-2d927f68cc64 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "26fdb428-7e41-4e0f-b91a-15009844089f", "tag": "60aa1d76-6fda-4493-91ab-da6bd2ca0a42"}]} {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:31:26.523544 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [req-31316c6a-93be-45e6-a15e-b62c7c5bd1fc req-b215764e-dc53-4fd7-a48a-2d927f68cc64 service nova] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:26.524914 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [req-31316c6a-93be-45e6-a15e-b62c7c5bd1fc req-b215764e-dc53-4fd7-a48a-2d927f68cc64 service nova] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:26.530556 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG dbcounter [-] [117670] Writing DB stats nova_cell1:SELECT=100 {{(pid=117670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:31:26.572489 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.compute.server_external_events [req-31316c6a-93be-45e6-a15e-b62c7c5bd1fc req-b215764e-dc53-4fd7-a48a-2d927f68cc64 service nova] Creating event network-changed:60aa1d76-6fda-4493-91ab-da6bd2ca0a42 for instance 26fdb428-7e41-4e0f-b91a-15009844089f on hv-cinder-81322 Jun 16 18:31:26.586065 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [req-31316c6a-93be-45e6-a15e-b62c7c5bd1fc req-b215764e-dc53-4fd7-a48a-2d927f68cc64 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099916 Jun 16 18:31:26.587152 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 168/319] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Jun 16 18:31:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:31:26.603750 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-a40a29ca-25a7-40db-80cd-456f6be8cb43 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:31:26.605272 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-a40a29ca-25a7-40db-80cd-456f6be8cb43 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] [instance: 651b5fe1-0df7-4bc6-b18e-7caea544a93f] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:31:26.627709 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-a40a29ca-25a7-40db-80cd-456f6be8cb43 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:26.629034 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-a40a29ca-25a7-40db-80cd-456f6be8cb43 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:26.632140 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-a40a29ca-25a7-40db-80cd-456f6be8cb43 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:26.633330 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-a40a29ca-25a7-40db-80cd-456f6be8cb43 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:27.460089 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG dbcounter [-] [117671] Writing DB stats nova_cell0:SELECT=16 {{(pid=117671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:31:27.670996 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-a40a29ca-25a7-40db-80cd-456f6be8cb43 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:31:27.685987 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-a40a29ca-25a7-40db-80cd-456f6be8cb43 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:31:27.693091 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-a40a29ca-25a7-40db-80cd-456f6be8cb43 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:31:27.709868 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-a40a29ca-25a7-40db-80cd-456f6be8cb43 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] 10.222.0.30 "GET /compute/v2.1/servers/651b5fe1-0df7-4bc6-b18e-7caea544a93f" status: 200 len: 1740 microversion: 2.20 time: 1.109434 Jun 16 18:31:27.710531 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 169/320] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Jun 16 18:31:26 2022] GET /compute/v2.1/servers/651b5fe1-0df7-4bc6-b18e-7caea544a93f => generated 1740 bytes in 1123 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:31:27.727492 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-2f42d431-9e57-4275-9237-b8f860137a70 tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:31:27.739966 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-2f42d431-9e57-4275-9237-b8f860137a70 tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] [instance: 26fdb428-7e41-4e0f-b91a-15009844089f] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:31:27.762511 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-2f42d431-9e57-4275-9237-b8f860137a70 tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:27.769772 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-2f42d431-9e57-4275-9237-b8f860137a70 tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:27.774953 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-2f42d431-9e57-4275-9237-b8f860137a70 tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:27.776688 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-2f42d431-9e57-4275-9237-b8f860137a70 tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:28.975169 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-2f42d431-9e57-4275-9237-b8f860137a70 tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7d57c4231b49b28a606a17e42267e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9fa2caa1412451aa0308c807d5c62d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:31:29.001300 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-2f42d431-9e57-4275-9237-b8f860137a70 tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] 10.222.0.30 "GET /compute/v2.1/servers/26fdb428-7e41-4e0f-b91a-15009844089f" status: 200 len: 1359 microversion: 2.1 time: 1.289267 Jun 16 18:31:29.002101 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 170/321] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:31:27 2022] GET /compute/v2.1/servers/26fdb428-7e41-4e0f-b91a-15009844089f => generated 1359 bytes in 1291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:31:29.038287 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-3d2f83a8-5d09-457d-9065-17fd95e184d0 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:31:29.039121 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-3d2f83a8-5d09-457d-9065-17fd95e184d0 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] [instance: 651b5fe1-0df7-4bc6-b18e-7caea544a93f] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:31:29.094527 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-3d2f83a8-5d09-457d-9065-17fd95e184d0 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:29.094986 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-3d2f83a8-5d09-457d-9065-17fd95e184d0 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:29.095798 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-3d2f83a8-5d09-457d-9065-17fd95e184d0 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:29.096284 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-3d2f83a8-5d09-457d-9065-17fd95e184d0 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:29.704761 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-3d2f83a8-5d09-457d-9065-17fd95e184d0 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:31:29.724329 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-3d2f83a8-5d09-457d-9065-17fd95e184d0 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:31:29.726211 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-3d2f83a8-5d09-457d-9065-17fd95e184d0 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:31:29.731498 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-3d2f83a8-5d09-457d-9065-17fd95e184d0 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] 10.222.0.30 "GET /compute/v2.1/servers/651b5fe1-0df7-4bc6-b18e-7caea544a93f" status: 200 len: 1740 microversion: 2.20 time: 0.727592 Jun 16 18:31:29.733980 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 171/322] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Jun 16 18:31:29 2022] GET /compute/v2.1/servers/651b5fe1-0df7-4bc6-b18e-7caea544a93f => generated 1740 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:31:30.035947 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-11779081-92f3-4ae0-bc4e-da8de1c8c5b0 tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:31:30.036728 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-11779081-92f3-4ae0-bc4e-da8de1c8c5b0 tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] [instance: 26fdb428-7e41-4e0f-b91a-15009844089f] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:31:30.052540 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-11779081-92f3-4ae0-bc4e-da8de1c8c5b0 tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:30.053058 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-11779081-92f3-4ae0-bc4e-da8de1c8c5b0 tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:30.053921 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-11779081-92f3-4ae0-bc4e-da8de1c8c5b0 tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:30.054342 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-11779081-92f3-4ae0-bc4e-da8de1c8c5b0 tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:31.006632 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-11779081-92f3-4ae0-bc4e-da8de1c8c5b0 tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7d57c4231b49b28a606a17e42267e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9fa2caa1412451aa0308c807d5c62d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:31:31.029457 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-11779081-92f3-4ae0-bc4e-da8de1c8c5b0 tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] 10.222.0.30 "GET /compute/v2.1/servers/26fdb428-7e41-4e0f-b91a-15009844089f" status: 200 len: 1359 microversion: 2.1 time: 0.998138 Jun 16 18:31:31.030964 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 172/323] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:31:30 2022] GET /compute/v2.1/servers/26fdb428-7e41-4e0f-b91a-15009844089f => generated 1359 bytes in 1001 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:31:31.037049 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-8b62a710-829d-4203-8307-0e03e7677aa9 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:31:31.038587 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-8b62a710-829d-4203-8307-0e03e7677aa9 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] [instance: 651b5fe1-0df7-4bc6-b18e-7caea544a93f] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:31:31.056303 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-8b62a710-829d-4203-8307-0e03e7677aa9 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:31.056891 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-8b62a710-829d-4203-8307-0e03e7677aa9 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:31.058602 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-8b62a710-829d-4203-8307-0e03e7677aa9 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:31.059789 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-8b62a710-829d-4203-8307-0e03e7677aa9 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:31.408636 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-8b62a710-829d-4203-8307-0e03e7677aa9 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:31:31.429180 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-8b62a710-829d-4203-8307-0e03e7677aa9 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:31:31.433462 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-8b62a710-829d-4203-8307-0e03e7677aa9 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:31:31.434831 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-8b62a710-829d-4203-8307-0e03e7677aa9 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] 10.222.0.30 "GET /compute/v2.1/servers/651b5fe1-0df7-4bc6-b18e-7caea544a93f" status: 200 len: 1740 microversion: 2.20 time: 0.402476 Jun 16 18:31:31.436894 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 173/324] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Jun 16 18:31:31 2022] GET /compute/v2.1/servers/651b5fe1-0df7-4bc6-b18e-7caea544a93f => generated 1740 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:31:31.743145 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG dbcounter [-] [117671] Writing DB stats nova_cell1:SELECT=99 {{(pid=117671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:31:31.884882 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG dbcounter [-] [117671] Writing DB stats nova_api:SELECT=78,nova_api:INSERT=5 {{(pid=117671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:31:32.090047 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-4a07ecc9-7d5d-4670-9d90-f9a1e9032a56 tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:31:32.098327 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-4a07ecc9-7d5d-4670-9d90-f9a1e9032a56 tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] [instance: 26fdb428-7e41-4e0f-b91a-15009844089f] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:31:32.122223 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-4a07ecc9-7d5d-4670-9d90-f9a1e9032a56 tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:32.132507 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-4a07ecc9-7d5d-4670-9d90-f9a1e9032a56 tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:32.142340 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-4a07ecc9-7d5d-4670-9d90-f9a1e9032a56 tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:32.153296 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-4a07ecc9-7d5d-4670-9d90-f9a1e9032a56 tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:32.774635 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-4a07ecc9-7d5d-4670-9d90-f9a1e9032a56 tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7d57c4231b49b28a606a17e42267e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9fa2caa1412451aa0308c807d5c62d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:31:32.803419 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-4a07ecc9-7d5d-4670-9d90-f9a1e9032a56 tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] 10.222.0.30 "GET /compute/v2.1/servers/26fdb428-7e41-4e0f-b91a-15009844089f" status: 200 len: 1359 microversion: 2.1 time: 0.745860 Jun 16 18:31:32.829181 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 174/325] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:31:32 2022] GET /compute/v2.1/servers/26fdb428-7e41-4e0f-b91a-15009844089f => generated 1359 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:31:32.848193 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-91c1e7cf-67f2-4862-a925-b452bda07f1c tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:31:32.853770 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-91c1e7cf-67f2-4862-a925-b452bda07f1c tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] [instance: 651b5fe1-0df7-4bc6-b18e-7caea544a93f] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:31:32.884856 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-91c1e7cf-67f2-4862-a925-b452bda07f1c tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:32.886094 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-91c1e7cf-67f2-4862-a925-b452bda07f1c tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:32.889929 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-91c1e7cf-67f2-4862-a925-b452bda07f1c tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:32.892742 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-91c1e7cf-67f2-4862-a925-b452bda07f1c tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:33.203326 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-91c1e7cf-67f2-4862-a925-b452bda07f1c tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:31:33.226924 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-91c1e7cf-67f2-4862-a925-b452bda07f1c tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:31:33.230185 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-91c1e7cf-67f2-4862-a925-b452bda07f1c tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:31:33.236701 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-91c1e7cf-67f2-4862-a925-b452bda07f1c tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] 10.222.0.30 "GET /compute/v2.1/servers/651b5fe1-0df7-4bc6-b18e-7caea544a93f" status: 200 len: 1740 microversion: 2.20 time: 0.399695 Jun 16 18:31:33.241132 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 175/326] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Jun 16 18:31:32 2022] GET /compute/v2.1/servers/651b5fe1-0df7-4bc6-b18e-7caea544a93f => generated 1740 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:31:33.838298 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-ab1a1618-0f6e-4aa0-a641-b47da545aed0 tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:31:33.838966 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-ab1a1618-0f6e-4aa0-a641-b47da545aed0 tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] [instance: 26fdb428-7e41-4e0f-b91a-15009844089f] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:31:33.841252 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG dbcounter [-] [117670] Writing DB stats nova_api:SELECT=78 {{(pid=117670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:31:33.856083 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-ab1a1618-0f6e-4aa0-a641-b47da545aed0 tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:33.860803 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-ab1a1618-0f6e-4aa0-a641-b47da545aed0 tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:33.862063 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-ab1a1618-0f6e-4aa0-a641-b47da545aed0 tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:33.862842 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-ab1a1618-0f6e-4aa0-a641-b47da545aed0 tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:34.000421 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.network.neutron [None req-ae927dc7-e8d8-41aa-a396-d53bd9a6a854 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] validate_networks() for [('15279682-d7de-41a6-80bc-29c22a949874', None, None, None, None, None)] {{(pid=117671) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 18:31:34.199970 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-ab1a1618-0f6e-4aa0-a641-b47da545aed0 tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7d57c4231b49b28a606a17e42267e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9fa2caa1412451aa0308c807d5c62d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:31:34.217757 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-ab1a1618-0f6e-4aa0-a641-b47da545aed0 tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] 10.222.0.30 "GET /compute/v2.1/servers/26fdb428-7e41-4e0f-b91a-15009844089f" status: 200 len: 1359 microversion: 2.1 time: 0.385585 Jun 16 18:31:34.228453 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 176/327] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:31:33 2022] GET /compute/v2.1/servers/26fdb428-7e41-4e0f-b91a-15009844089f => generated 1359 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:31:34.263915 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-8d8825b2-25b1-4577-bb7e-6b107d2c7883 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:31:34.264838 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-8d8825b2-25b1-4577-bb7e-6b107d2c7883 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] [instance: 651b5fe1-0df7-4bc6-b18e-7caea544a93f] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:31:34.278144 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-8d8825b2-25b1-4577-bb7e-6b107d2c7883 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:34.280727 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-8d8825b2-25b1-4577-bb7e-6b107d2c7883 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:34.281568 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-8d8825b2-25b1-4577-bb7e-6b107d2c7883 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:34.282012 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-8d8825b2-25b1-4577-bb7e-6b107d2c7883 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:34.739084 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-8d8825b2-25b1-4577-bb7e-6b107d2c7883 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:31:34.774678 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-8d8825b2-25b1-4577-bb7e-6b107d2c7883 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:31:34.780609 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-8d8825b2-25b1-4577-bb7e-6b107d2c7883 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:31:34.795723 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-8d8825b2-25b1-4577-bb7e-6b107d2c7883 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] 10.222.0.30 "GET /compute/v2.1/servers/651b5fe1-0df7-4bc6-b18e-7caea544a93f" status: 200 len: 1740 microversion: 2.20 time: 0.528161 Jun 16 18:31:34.797645 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 177/328] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Jun 16 18:31:34 2022] GET /compute/v2.1/servers/651b5fe1-0df7-4bc6-b18e-7caea544a93f => generated 1740 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 18:31:34.996449 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.virt.hardware [None req-ae927dc7-e8d8-41aa-a396-d53bd9a6a854 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Flavor limits 0:0:0 {{(pid=117671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 18:31:34.997550 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.virt.hardware [None req-ae927dc7-e8d8-41aa-a396-d53bd9a6a854 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Image limits 0:0:0 {{(pid=117671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 18:31:34.998594 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.virt.hardware [None req-ae927dc7-e8d8-41aa-a396-d53bd9a6a854 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Flavor pref 0:0:0 {{(pid=117671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 18:31:34.999384 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.virt.hardware [None req-ae927dc7-e8d8-41aa-a396-d53bd9a6a854 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Image pref 0:0:0 {{(pid=117671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 18:31:35.000174 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.virt.hardware [None req-ae927dc7-e8d8-41aa-a396-d53bd9a6a854 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 18:31:35.035821 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-ae927dc7-e8d8-41aa-a396-d53bd9a6a854 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:35.036623 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-ae927dc7-e8d8-41aa-a396-d53bd9a6a854 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:35.037941 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-ae927dc7-e8d8-41aa-a396-d53bd9a6a854 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:35.048462 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-ae927dc7-e8d8-41aa-a396-d53bd9a6a854 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:35.106621 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.quota [None req-ae927dc7-e8d8-41aa-a396-d53bd9a6a854 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Getting quotas for project b70bbccf07e3404cb94ba59201061a6a. Resources: {'instances', 'ram', 'cores'} {{(pid=117671) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 18:31:35.117961 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.quota [None req-ae927dc7-e8d8-41aa-a396-d53bd9a6a854 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Getting quotas for user 512f01cca14b447c8f6c9eebbd828eb2 and project b70bbccf07e3404cb94ba59201061a6a. Resources: {'instances', 'ram', 'cores'} {{(pid=117671) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 18:31:35.138312 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-ae927dc7-e8d8-41aa-a396-d53bd9a6a854 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Going to run 1 instances... {{(pid=117671) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 18:31:35.142273 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-ae927dc7-e8d8-41aa-a396-d53bd9a6a854 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] [instance: e10b3f49-1ff3-474c-833b-b83e3300e617] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='38ef083a-a9ff-4836-8954-f770268ba205',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117671) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 18:31:35.209670 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-ae927dc7-e8d8-41aa-a396-d53bd9a6a854 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 13.365950 Jun 16 18:31:35.211028 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 152/329] 10.222.0.30 () {60 vars in 1146 bytes} [Thu Jun 16 18:31:21 2022] POST /compute/v2.1/servers => generated 408 bytes in 13369 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 18:31:35.224461 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-1a40a244-2494-4731-a78b-4b47fda9b345 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:31:35.225637 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-1a40a244-2494-4731-a78b-4b47fda9b345 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] [instance: e10b3f49-1ff3-474c-833b-b83e3300e617] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:31:35.246204 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-50bddc44-75c2-4653-ac4b-639586396a6e tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:31:35.247587 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-50bddc44-75c2-4653-ac4b-639586396a6e tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] [instance: 26fdb428-7e41-4e0f-b91a-15009844089f] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:31:35.263336 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-50bddc44-75c2-4653-ac4b-639586396a6e tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:35.264531 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-50bddc44-75c2-4653-ac4b-639586396a6e tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:35.266166 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-50bddc44-75c2-4653-ac4b-639586396a6e tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:35.267535 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-50bddc44-75c2-4653-ac4b-639586396a6e tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:35.406145 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-1a40a244-2494-4731-a78b-4b47fda9b345 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512f01cca14b447c8f6c9eebbd828eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70bbccf07e3404cb94ba59201061a6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:31:35.414064 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-1a40a244-2494-4731-a78b-4b47fda9b345 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] 10.222.0.30 "GET /compute/v2.1/servers/e10b3f49-1ff3-474c-833b-b83e3300e617" status: 200 len: 1246 microversion: 2.1 time: 0.195149 Jun 16 18:31:35.422177 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 178/330] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:31:35 2022] GET /compute/v2.1/servers/e10b3f49-1ff3-474c-833b-b83e3300e617 => generated 1246 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:31:35.666208 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-50bddc44-75c2-4653-ac4b-639586396a6e tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7d57c4231b49b28a606a17e42267e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9fa2caa1412451aa0308c807d5c62d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:31:35.677802 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-50bddc44-75c2-4653-ac4b-639586396a6e tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] 10.222.0.30 "GET /compute/v2.1/servers/26fdb428-7e41-4e0f-b91a-15009844089f" status: 200 len: 1359 microversion: 2.1 time: 0.445268 Jun 16 18:31:35.679008 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 153/331] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:31:35 2022] GET /compute/v2.1/servers/26fdb428-7e41-4e0f-b91a-15009844089f => generated 1359 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:31:35.822671 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-3ac81d1e-3e2a-4fa6-88c2-559fcb9c084e tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:31:35.823791 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-3ac81d1e-3e2a-4fa6-88c2-559fcb9c084e tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] [instance: 651b5fe1-0df7-4bc6-b18e-7caea544a93f] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:31:35.876513 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-3ac81d1e-3e2a-4fa6-88c2-559fcb9c084e tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:35.877670 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-3ac81d1e-3e2a-4fa6-88c2-559fcb9c084e tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:35.879379 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-3ac81d1e-3e2a-4fa6-88c2-559fcb9c084e tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:35.880288 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-3ac81d1e-3e2a-4fa6-88c2-559fcb9c084e tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:36.453401 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-de6cfac5-92ef-4fa0-b9ac-01bf4ae31ee6 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:31:36.454514 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-de6cfac5-92ef-4fa0-b9ac-01bf4ae31ee6 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] [instance: e10b3f49-1ff3-474c-833b-b83e3300e617] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:31:36.499520 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-de6cfac5-92ef-4fa0-b9ac-01bf4ae31ee6 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:36.514128 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-de6cfac5-92ef-4fa0-b9ac-01bf4ae31ee6 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:36.518148 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-de6cfac5-92ef-4fa0-b9ac-01bf4ae31ee6 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:36.526110 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-de6cfac5-92ef-4fa0-b9ac-01bf4ae31ee6 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:36.734427 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-3ac81d1e-3e2a-4fa6-88c2-559fcb9c084e tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:31:36.767391 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-3ac81d1e-3e2a-4fa6-88c2-559fcb9c084e tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:31:36.772875 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-de6cfac5-92ef-4fa0-b9ac-01bf4ae31ee6 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512f01cca14b447c8f6c9eebbd828eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70bbccf07e3404cb94ba59201061a6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:31:36.775033 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-3ac81d1e-3e2a-4fa6-88c2-559fcb9c084e tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:31:36.792511 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-3ac81d1e-3e2a-4fa6-88c2-559fcb9c084e tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] 10.222.0.30 "GET /compute/v2.1/servers/651b5fe1-0df7-4bc6-b18e-7caea544a93f" status: 200 len: 1722 microversion: 2.20 time: 0.962510 Jun 16 18:31:36.804147 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-de6cfac5-92ef-4fa0-b9ac-01bf4ae31ee6 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] 10.222.0.30 "GET /compute/v2.1/servers/e10b3f49-1ff3-474c-833b-b83e3300e617" status: 200 len: 1250 microversion: 2.1 time: 0.345939 Jun 16 18:31:36.804383 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 179/332] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Jun 16 18:31:35 2022] GET /compute/v2.1/servers/651b5fe1-0df7-4bc6-b18e-7caea544a93f => generated 1722 bytes in 985 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:31:36.805643 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 154/333] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:31:36 2022] GET /compute/v2.1/servers/e10b3f49-1ff3-474c-833b-b83e3300e617 => generated 1250 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:31:36.820616 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-a7a65cbf-2603-4f19-97b6-26b551b3e8e8 tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:31:36.824888 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-a7a65cbf-2603-4f19-97b6-26b551b3e8e8 tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] [instance: 26fdb428-7e41-4e0f-b91a-15009844089f] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:31:36.843013 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-a7a65cbf-2603-4f19-97b6-26b551b3e8e8 tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:36.844258 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-a7a65cbf-2603-4f19-97b6-26b551b3e8e8 tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:36.848281 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-a7a65cbf-2603-4f19-97b6-26b551b3e8e8 tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:36.849191 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-a7a65cbf-2603-4f19-97b6-26b551b3e8e8 tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:37.253360 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-a7a65cbf-2603-4f19-97b6-26b551b3e8e8 tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7d57c4231b49b28a606a17e42267e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9fa2caa1412451aa0308c807d5c62d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:31:37.283411 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-a7a65cbf-2603-4f19-97b6-26b551b3e8e8 tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] 10.222.0.30 "GET /compute/v2.1/servers/26fdb428-7e41-4e0f-b91a-15009844089f" status: 200 len: 1359 microversion: 2.1 time: 0.479159 Jun 16 18:31:37.285336 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 180/334] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:31:36 2022] GET /compute/v2.1/servers/26fdb428-7e41-4e0f-b91a-15009844089f => generated 1359 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:31:37.819613 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-18376e6f-8526-4323-a6a2-2591871a4444 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:31:37.821552 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-18376e6f-8526-4323-a6a2-2591871a4444 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] [instance: 651b5fe1-0df7-4bc6-b18e-7caea544a93f] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:31:37.826731 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-5b996396-8eda-4e6b-968c-0faa65efe4d0 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:31:37.827881 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-5b996396-8eda-4e6b-968c-0faa65efe4d0 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] [instance: e10b3f49-1ff3-474c-833b-b83e3300e617] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:31:37.851950 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-18376e6f-8526-4323-a6a2-2591871a4444 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:37.853865 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-18376e6f-8526-4323-a6a2-2591871a4444 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:37.855783 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-18376e6f-8526-4323-a6a2-2591871a4444 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:37.857030 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-18376e6f-8526-4323-a6a2-2591871a4444 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:37.865020 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-5b996396-8eda-4e6b-968c-0faa65efe4d0 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:37.865825 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-5b996396-8eda-4e6b-968c-0faa65efe4d0 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:37.867218 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-5b996396-8eda-4e6b-968c-0faa65efe4d0 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:37.868610 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-5b996396-8eda-4e6b-968c-0faa65efe4d0 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:38.282456 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-5b996396-8eda-4e6b-968c-0faa65efe4d0 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512f01cca14b447c8f6c9eebbd828eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70bbccf07e3404cb94ba59201061a6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:31:38.328920 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-5b996396-8eda-4e6b-968c-0faa65efe4d0 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] 10.222.0.30 "GET /compute/v2.1/servers/e10b3f49-1ff3-474c-833b-b83e3300e617" status: 200 len: 1298 microversion: 2.1 time: 0.496790 Jun 16 18:31:38.353810 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 181/335] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:31:37 2022] GET /compute/v2.1/servers/e10b3f49-1ff3-474c-833b-b83e3300e617 => generated 1298 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:31:38.378893 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-ce7acd5f-ee8d-4a95-be90-dde49c60165c tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:31:38.381885 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-ce7acd5f-ee8d-4a95-be90-dde49c60165c tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] [instance: 26fdb428-7e41-4e0f-b91a-15009844089f] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:31:38.394745 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-18376e6f-8526-4323-a6a2-2591871a4444 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:31:38.408646 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-ce7acd5f-ee8d-4a95-be90-dde49c60165c tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:38.413079 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-ce7acd5f-ee8d-4a95-be90-dde49c60165c tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:38.421319 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-ce7acd5f-ee8d-4a95-be90-dde49c60165c tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:38.422459 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-ce7acd5f-ee8d-4a95-be90-dde49c60165c tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:38.435182 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-18376e6f-8526-4323-a6a2-2591871a4444 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:31:38.439183 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-18376e6f-8526-4323-a6a2-2591871a4444 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:31:38.441586 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-18376e6f-8526-4323-a6a2-2591871a4444 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] 10.222.0.30 "GET /compute/v2.1/servers/651b5fe1-0df7-4bc6-b18e-7caea544a93f" status: 200 len: 1722 microversion: 2.20 time: 0.630849 Jun 16 18:31:38.456983 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 155/336] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Jun 16 18:31:37 2022] GET /compute/v2.1/servers/651b5fe1-0df7-4bc6-b18e-7caea544a93f => generated 1722 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:31:38.679733 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [req-70a5d600-b47f-489a-875a-1c83610b9369 req-120b8dfc-3d0d-45ce-a252-12c6cba40389 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "651b5fe1-0df7-4bc6-b18e-7caea544a93f", "name": "network-vif-unplugged", "status": "completed", "tag": "7416c7c3-1e79-4777-a950-c0c27847ca8e"}]} {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:31:38.701121 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [req-70a5d600-b47f-489a-875a-1c83610b9369 req-120b8dfc-3d0d-45ce-a252-12c6cba40389 service nova] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:38.702887 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [req-70a5d600-b47f-489a-875a-1c83610b9369 req-120b8dfc-3d0d-45ce-a252-12c6cba40389 service nova] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:38.726918 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.compute.server_external_events [req-70a5d600-b47f-489a-875a-1c83610b9369 req-120b8dfc-3d0d-45ce-a252-12c6cba40389 service nova] Creating event network-vif-unplugged:7416c7c3-1e79-4777-a950-c0c27847ca8e for instance 651b5fe1-0df7-4bc6-b18e-7caea544a93f on hv-cinder-81322 Jun 16 18:31:38.738596 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [req-70a5d600-b47f-489a-875a-1c83610b9369 req-120b8dfc-3d0d-45ce-a252-12c6cba40389 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.066242 Jun 16 18:31:38.744762 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 156/337] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Jun 16 18:31:38 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:31:38.888079 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-ce7acd5f-ee8d-4a95-be90-dde49c60165c tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7d57c4231b49b28a606a17e42267e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9fa2caa1412451aa0308c807d5c62d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:31:38.928511 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-ce7acd5f-ee8d-4a95-be90-dde49c60165c tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] 10.222.0.30 "GET /compute/v2.1/servers/26fdb428-7e41-4e0f-b91a-15009844089f" status: 200 len: 1359 microversion: 2.1 time: 0.566662 Jun 16 18:31:38.930062 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 182/338] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:31:38 2022] GET /compute/v2.1/servers/26fdb428-7e41-4e0f-b91a-15009844089f => generated 1359 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:31:39.375138 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-a2ed1df9-72ad-453e-b3d3-17c363e99a81 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:31:39.376675 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-a2ed1df9-72ad-453e-b3d3-17c363e99a81 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] [instance: e10b3f49-1ff3-474c-833b-b83e3300e617] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:31:39.385172 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-a2ed1df9-72ad-453e-b3d3-17c363e99a81 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:39.385172 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-a2ed1df9-72ad-453e-b3d3-17c363e99a81 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:39.385938 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-a2ed1df9-72ad-453e-b3d3-17c363e99a81 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:39.386264 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-a2ed1df9-72ad-453e-b3d3-17c363e99a81 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:39.471981 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-a2ed1df9-72ad-453e-b3d3-17c363e99a81 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512f01cca14b447c8f6c9eebbd828eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70bbccf07e3404cb94ba59201061a6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:31:39.484815 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-2fbe3010-ed9a-41b1-bb0b-ae604e786438 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:31:39.486226 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-2fbe3010-ed9a-41b1-bb0b-ae604e786438 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] [instance: 651b5fe1-0df7-4bc6-b18e-7caea544a93f] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:31:39.487794 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-a2ed1df9-72ad-453e-b3d3-17c363e99a81 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] 10.222.0.30 "GET /compute/v2.1/servers/e10b3f49-1ff3-474c-833b-b83e3300e617" status: 200 len: 1298 microversion: 2.1 time: 0.118123 Jun 16 18:31:39.488865 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 157/339] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:31:39 2022] GET /compute/v2.1/servers/e10b3f49-1ff3-474c-833b-b83e3300e617 => generated 1298 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:31:39.503592 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-2fbe3010-ed9a-41b1-bb0b-ae604e786438 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:39.504789 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-2fbe3010-ed9a-41b1-bb0b-ae604e786438 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:39.506136 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-2fbe3010-ed9a-41b1-bb0b-ae604e786438 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:39.506717 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-2fbe3010-ed9a-41b1-bb0b-ae604e786438 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:39.735570 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-2fbe3010-ed9a-41b1-bb0b-ae604e786438 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:31:39.745315 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-2fbe3010-ed9a-41b1-bb0b-ae604e786438 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:31:39.747021 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-2fbe3010-ed9a-41b1-bb0b-ae604e786438 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:31:39.748391 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-2fbe3010-ed9a-41b1-bb0b-ae604e786438 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] 10.222.0.30 "GET /compute/v2.1/servers/651b5fe1-0df7-4bc6-b18e-7caea544a93f" status: 200 len: 1722 microversion: 2.20 time: 0.271212 Jun 16 18:31:39.749238 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 183/340] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Jun 16 18:31:39 2022] GET /compute/v2.1/servers/651b5fe1-0df7-4bc6-b18e-7caea544a93f => generated 1722 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:31:39.951381 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-3c57a266-8742-4a6d-b005-b251a637987f tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:31:39.952103 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-3c57a266-8742-4a6d-b005-b251a637987f tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] [instance: 26fdb428-7e41-4e0f-b91a-15009844089f] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:31:39.958738 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-3c57a266-8742-4a6d-b005-b251a637987f tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:39.959491 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-3c57a266-8742-4a6d-b005-b251a637987f tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:39.960315 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-3c57a266-8742-4a6d-b005-b251a637987f tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:39.960827 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-3c57a266-8742-4a6d-b005-b251a637987f tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:40.181937 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-3c57a266-8742-4a6d-b005-b251a637987f tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7d57c4231b49b28a606a17e42267e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9fa2caa1412451aa0308c807d5c62d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:31:40.212435 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-3c57a266-8742-4a6d-b005-b251a637987f tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] 10.222.0.30 "GET /compute/v2.1/servers/26fdb428-7e41-4e0f-b91a-15009844089f" status: 200 len: 1359 microversion: 2.1 time: 0.266911 Jun 16 18:31:40.256853 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 158/341] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:31:39 2022] GET /compute/v2.1/servers/26fdb428-7e41-4e0f-b91a-15009844089f => generated 1359 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:31:40.513967 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-f4936e23-b279-446e-8bd8-cf57175e4f95 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:31:40.514704 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-f4936e23-b279-446e-8bd8-cf57175e4f95 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] [instance: e10b3f49-1ff3-474c-833b-b83e3300e617] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:31:40.522037 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-f4936e23-b279-446e-8bd8-cf57175e4f95 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:40.522497 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-f4936e23-b279-446e-8bd8-cf57175e4f95 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:40.523277 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-f4936e23-b279-446e-8bd8-cf57175e4f95 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:40.523712 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-f4936e23-b279-446e-8bd8-cf57175e4f95 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:40.623509 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-f4936e23-b279-446e-8bd8-cf57175e4f95 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512f01cca14b447c8f6c9eebbd828eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70bbccf07e3404cb94ba59201061a6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:31:40.632556 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-f4936e23-b279-446e-8bd8-cf57175e4f95 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] 10.222.0.30 "GET /compute/v2.1/servers/e10b3f49-1ff3-474c-833b-b83e3300e617" status: 200 len: 1316 microversion: 2.1 time: 0.122474 Jun 16 18:31:40.633770 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 184/342] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:31:40 2022] GET /compute/v2.1/servers/e10b3f49-1ff3-474c-833b-b83e3300e617 => generated 1316 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:31:40.774525 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-e32819b8-cca2-4deb-95f4-e780867702e9 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:31:40.774525 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-e32819b8-cca2-4deb-95f4-e780867702e9 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] [instance: 651b5fe1-0df7-4bc6-b18e-7caea544a93f] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:31:40.782317 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-e32819b8-cca2-4deb-95f4-e780867702e9 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:40.782776 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-e32819b8-cca2-4deb-95f4-e780867702e9 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:40.783632 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-e32819b8-cca2-4deb-95f4-e780867702e9 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:40.784329 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-e32819b8-cca2-4deb-95f4-e780867702e9 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:40.961203 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-e32819b8-cca2-4deb-95f4-e780867702e9 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:31:40.973214 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-e32819b8-cca2-4deb-95f4-e780867702e9 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:31:40.975009 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-e32819b8-cca2-4deb-95f4-e780867702e9 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:31:40.976336 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-e32819b8-cca2-4deb-95f4-e780867702e9 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] 10.222.0.30 "GET /compute/v2.1/servers/651b5fe1-0df7-4bc6-b18e-7caea544a93f" status: 200 len: 1722 microversion: 2.20 time: 0.208659 Jun 16 18:31:40.977008 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 159/343] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Jun 16 18:31:40 2022] GET /compute/v2.1/servers/651b5fe1-0df7-4bc6-b18e-7caea544a93f => generated 1722 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:31:41.263796 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-e48b4049-e2f5-4f9b-bf2d-a9fdb7b2aa03 tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:31:41.264476 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-e48b4049-e2f5-4f9b-bf2d-a9fdb7b2aa03 tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] [instance: 26fdb428-7e41-4e0f-b91a-15009844089f] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:31:41.271138 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-e48b4049-e2f5-4f9b-bf2d-a9fdb7b2aa03 tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:41.271591 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-e48b4049-e2f5-4f9b-bf2d-a9fdb7b2aa03 tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:41.272462 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-e48b4049-e2f5-4f9b-bf2d-a9fdb7b2aa03 tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:41.273037 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-e48b4049-e2f5-4f9b-bf2d-a9fdb7b2aa03 tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:41.460538 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-e48b4049-e2f5-4f9b-bf2d-a9fdb7b2aa03 tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7d57c4231b49b28a606a17e42267e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9fa2caa1412451aa0308c807d5c62d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:31:41.473548 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-e48b4049-e2f5-4f9b-bf2d-a9fdb7b2aa03 tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] 10.222.0.30 "GET /compute/v2.1/servers/26fdb428-7e41-4e0f-b91a-15009844089f" status: 200 len: 1359 microversion: 2.1 time: 0.212568 Jun 16 18:31:41.474184 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 185/344] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:31:41 2022] GET /compute/v2.1/servers/26fdb428-7e41-4e0f-b91a-15009844089f => generated 1359 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:31:41.654560 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-7c15af31-c1e0-42af-8da0-cc927117e266 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:31:41.655567 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-7c15af31-c1e0-42af-8da0-cc927117e266 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] [instance: e10b3f49-1ff3-474c-833b-b83e3300e617] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:31:41.670867 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-7c15af31-c1e0-42af-8da0-cc927117e266 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:41.671329 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-7c15af31-c1e0-42af-8da0-cc927117e266 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:41.672170 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-7c15af31-c1e0-42af-8da0-cc927117e266 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:41.672614 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-7c15af31-c1e0-42af-8da0-cc927117e266 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:41.816100 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-7c15af31-c1e0-42af-8da0-cc927117e266 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512f01cca14b447c8f6c9eebbd828eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70bbccf07e3404cb94ba59201061a6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:31:41.833697 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-7c15af31-c1e0-42af-8da0-cc927117e266 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] 10.222.0.30 "GET /compute/v2.1/servers/e10b3f49-1ff3-474c-833b-b83e3300e617" status: 200 len: 1316 microversion: 2.1 time: 0.184210 Jun 16 18:31:41.834689 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 160/345] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:31:41 2022] GET /compute/v2.1/servers/e10b3f49-1ff3-474c-833b-b83e3300e617 => generated 1316 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:31:42.005058 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-453f221d-bb73-454b-93d5-46608c325825 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:31:42.006317 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-453f221d-bb73-454b-93d5-46608c325825 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] [instance: 651b5fe1-0df7-4bc6-b18e-7caea544a93f] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:31:42.019789 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-453f221d-bb73-454b-93d5-46608c325825 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:42.020605 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-453f221d-bb73-454b-93d5-46608c325825 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:42.022256 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-453f221d-bb73-454b-93d5-46608c325825 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:42.023399 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-453f221d-bb73-454b-93d5-46608c325825 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:42.056542 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG dbcounter [-] [117670] Writing DB stats nova_cell1:SELECT=100 {{(pid=117670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:31:42.258984 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-453f221d-bb73-454b-93d5-46608c325825 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:31:42.278398 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-453f221d-bb73-454b-93d5-46608c325825 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:31:42.282345 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-453f221d-bb73-454b-93d5-46608c325825 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:31:42.284676 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-453f221d-bb73-454b-93d5-46608c325825 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] 10.222.0.30 "GET /compute/v2.1/servers/651b5fe1-0df7-4bc6-b18e-7caea544a93f" status: 200 len: 1722 microversion: 2.20 time: 0.290447 Jun 16 18:31:42.285744 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 186/346] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Jun 16 18:31:41 2022] GET /compute/v2.1/servers/651b5fe1-0df7-4bc6-b18e-7caea544a93f => generated 1722 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 18:31:42.493479 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-d2fb6a8a-0453-4c56-bd30-8c4b2a7b82ac tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:31:42.494136 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-d2fb6a8a-0453-4c56-bd30-8c4b2a7b82ac tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] [instance: 26fdb428-7e41-4e0f-b91a-15009844089f] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:31:42.505207 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-d2fb6a8a-0453-4c56-bd30-8c4b2a7b82ac tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:42.505646 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-d2fb6a8a-0453-4c56-bd30-8c4b2a7b82ac tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:42.506862 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-d2fb6a8a-0453-4c56-bd30-8c4b2a7b82ac tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:42.507495 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-d2fb6a8a-0453-4c56-bd30-8c4b2a7b82ac tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:42.742073 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-d2fb6a8a-0453-4c56-bd30-8c4b2a7b82ac tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7d57c4231b49b28a606a17e42267e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9fa2caa1412451aa0308c807d5c62d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:31:42.754324 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-d2fb6a8a-0453-4c56-bd30-8c4b2a7b82ac tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] 10.222.0.30 "GET /compute/v2.1/servers/26fdb428-7e41-4e0f-b91a-15009844089f" status: 200 len: 1359 microversion: 2.1 time: 0.265411 Jun 16 18:31:42.758690 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 161/347] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:31:42 2022] GET /compute/v2.1/servers/26fdb428-7e41-4e0f-b91a-15009844089f => generated 1359 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:31:42.860556 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-108affae-0245-4573-81ee-8bdcb9226e32 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:31:42.861182 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-108affae-0245-4573-81ee-8bdcb9226e32 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] [instance: e10b3f49-1ff3-474c-833b-b83e3300e617] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:31:42.868435 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-108affae-0245-4573-81ee-8bdcb9226e32 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:42.869126 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-108affae-0245-4573-81ee-8bdcb9226e32 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:42.869945 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-108affae-0245-4573-81ee-8bdcb9226e32 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:42.870389 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-108affae-0245-4573-81ee-8bdcb9226e32 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:43.025317 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-108affae-0245-4573-81ee-8bdcb9226e32 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512f01cca14b447c8f6c9eebbd828eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70bbccf07e3404cb94ba59201061a6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:31:43.033273 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-108affae-0245-4573-81ee-8bdcb9226e32 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] 10.222.0.30 "GET /compute/v2.1/servers/e10b3f49-1ff3-474c-833b-b83e3300e617" status: 200 len: 1371 microversion: 2.1 time: 0.176965 Jun 16 18:31:43.033995 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 187/348] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:31:42 2022] GET /compute/v2.1/servers/e10b3f49-1ff3-474c-833b-b83e3300e617 => generated 1371 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:31:43.312298 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-e4ca75f2-ce56-4923-b8aa-6398d1be10f6 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:31:43.312891 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-e4ca75f2-ce56-4923-b8aa-6398d1be10f6 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] [instance: 651b5fe1-0df7-4bc6-b18e-7caea544a93f] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:31:43.319291 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-e4ca75f2-ce56-4923-b8aa-6398d1be10f6 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:43.319735 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-e4ca75f2-ce56-4923-b8aa-6398d1be10f6 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:43.321302 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-e4ca75f2-ce56-4923-b8aa-6398d1be10f6 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:43.321750 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-e4ca75f2-ce56-4923-b8aa-6398d1be10f6 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:43.477998 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-e4ca75f2-ce56-4923-b8aa-6398d1be10f6 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:31:43.489274 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-e4ca75f2-ce56-4923-b8aa-6398d1be10f6 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:31:43.490790 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-e4ca75f2-ce56-4923-b8aa-6398d1be10f6 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:31:43.491994 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-e4ca75f2-ce56-4923-b8aa-6398d1be10f6 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] 10.222.0.30 "GET /compute/v2.1/servers/651b5fe1-0df7-4bc6-b18e-7caea544a93f" status: 200 len: 1722 microversion: 2.20 time: 0.183808 Jun 16 18:31:43.493243 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 162/349] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Jun 16 18:31:43 2022] GET /compute/v2.1/servers/651b5fe1-0df7-4bc6-b18e-7caea544a93f => generated 1722 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:31:43.775123 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-cf08b2de-df11-4f7d-9af8-1b060fdeffba tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:31:43.775758 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-cf08b2de-df11-4f7d-9af8-1b060fdeffba tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] [instance: 26fdb428-7e41-4e0f-b91a-15009844089f] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:31:43.782533 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-cf08b2de-df11-4f7d-9af8-1b060fdeffba tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:43.782984 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-cf08b2de-df11-4f7d-9af8-1b060fdeffba tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:43.783788 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-cf08b2de-df11-4f7d-9af8-1b060fdeffba tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:43.784275 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-cf08b2de-df11-4f7d-9af8-1b060fdeffba tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:43.985905 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-cf08b2de-df11-4f7d-9af8-1b060fdeffba tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7d57c4231b49b28a606a17e42267e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9fa2caa1412451aa0308c807d5c62d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:31:44.012882 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-cf08b2de-df11-4f7d-9af8-1b060fdeffba tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] 10.222.0.30 "GET /compute/v2.1/servers/26fdb428-7e41-4e0f-b91a-15009844089f" status: 200 len: 1359 microversion: 2.1 time: 0.242202 Jun 16 18:31:44.013579 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 188/350] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:31:43 2022] GET /compute/v2.1/servers/26fdb428-7e41-4e0f-b91a-15009844089f => generated 1359 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:31:44.053595 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-dd00493f-7e5e-497b-bb88-c86101e69ee3 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:31:44.054602 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-dd00493f-7e5e-497b-bb88-c86101e69ee3 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] [instance: e10b3f49-1ff3-474c-833b-b83e3300e617] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:31:44.062621 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-dd00493f-7e5e-497b-bb88-c86101e69ee3 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:44.063328 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-dd00493f-7e5e-497b-bb88-c86101e69ee3 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:44.064332 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-dd00493f-7e5e-497b-bb88-c86101e69ee3 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:44.064890 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-dd00493f-7e5e-497b-bb88-c86101e69ee3 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:44.230331 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [req-3eb77f1f-c70e-4b60-b886-5898900cbabd req-bdcbfa9e-d804-40fe-ad08-c93513c8b396 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26fdb428-7e41-4e0f-b91a-15009844089f", "name": "network-vif-plugged", "status": "completed", "tag": "60aa1d76-6fda-4493-91ab-da6bd2ca0a42"}]} {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:31:44.239946 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [req-3eb77f1f-c70e-4b60-b886-5898900cbabd req-bdcbfa9e-d804-40fe-ad08-c93513c8b396 service nova] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:44.240681 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [req-3eb77f1f-c70e-4b60-b886-5898900cbabd req-bdcbfa9e-d804-40fe-ad08-c93513c8b396 service nova] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:44.256171 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.compute.server_external_events [req-3eb77f1f-c70e-4b60-b886-5898900cbabd req-bdcbfa9e-d804-40fe-ad08-c93513c8b396 service nova] Creating event network-vif-plugged:60aa1d76-6fda-4493-91ab-da6bd2ca0a42 for instance 26fdb428-7e41-4e0f-b91a-15009844089f on hv-cinder-81322 Jun 16 18:31:44.263556 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [req-3eb77f1f-c70e-4b60-b886-5898900cbabd req-bdcbfa9e-d804-40fe-ad08-c93513c8b396 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036686 Jun 16 18:31:44.264563 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 189/351] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Jun 16 18:31:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 18:31:44.398182 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-dd00493f-7e5e-497b-bb88-c86101e69ee3 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512f01cca14b447c8f6c9eebbd828eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70bbccf07e3404cb94ba59201061a6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:31:44.407115 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-dd00493f-7e5e-497b-bb88-c86101e69ee3 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] 10.222.0.30 "GET /compute/v2.1/servers/e10b3f49-1ff3-474c-833b-b83e3300e617" status: 200 len: 1371 microversion: 2.1 time: 0.357814 Jun 16 18:31:44.407994 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 163/352] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:31:44 2022] GET /compute/v2.1/servers/e10b3f49-1ff3-474c-833b-b83e3300e617 => generated 1371 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:31:44.514933 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-cd63f559-1abf-475d-9b27-4bab59fc1809 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:31:44.515948 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-cd63f559-1abf-475d-9b27-4bab59fc1809 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] [instance: 651b5fe1-0df7-4bc6-b18e-7caea544a93f] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:31:44.523519 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-cd63f559-1abf-475d-9b27-4bab59fc1809 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:44.523981 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-cd63f559-1abf-475d-9b27-4bab59fc1809 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:44.525097 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-cd63f559-1abf-475d-9b27-4bab59fc1809 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:44.525578 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-cd63f559-1abf-475d-9b27-4bab59fc1809 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:44.786605 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [req-b9ba0021-324c-4569-b0f6-14c5903d1d11 req-c7d63c72-8664-4631-8abb-30b03b095737 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e10b3f49-1ff3-474c-833b-b83e3300e617", "tag": "415b1820-aec4-49ee-8ec3-7e34692c9dc5"}]} {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:31:44.814684 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [req-b9ba0021-324c-4569-b0f6-14c5903d1d11 req-c7d63c72-8664-4631-8abb-30b03b095737 service nova] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:44.815539 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [req-b9ba0021-324c-4569-b0f6-14c5903d1d11 req-c7d63c72-8664-4631-8abb-30b03b095737 service nova] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:44.840356 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-cd63f559-1abf-475d-9b27-4bab59fc1809 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:31:44.844752 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.compute.server_external_events [req-b9ba0021-324c-4569-b0f6-14c5903d1d11 req-c7d63c72-8664-4631-8abb-30b03b095737 service nova] Creating event network-changed:415b1820-aec4-49ee-8ec3-7e34692c9dc5 for instance e10b3f49-1ff3-474c-833b-b83e3300e617 on hv-cinder-81322 Jun 16 18:31:44.856618 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-cd63f559-1abf-475d-9b27-4bab59fc1809 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:31:44.858444 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-cd63f559-1abf-475d-9b27-4bab59fc1809 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:31:44.859518 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-cd63f559-1abf-475d-9b27-4bab59fc1809 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] 10.222.0.30 "GET /compute/v2.1/servers/651b5fe1-0df7-4bc6-b18e-7caea544a93f" status: 200 len: 1665 microversion: 2.20 time: 0.351615 Jun 16 18:31:44.860450 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 190/353] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Jun 16 18:31:44 2022] GET /compute/v2.1/servers/651b5fe1-0df7-4bc6-b18e-7caea544a93f => generated 1665 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 18:31:44.866814 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [req-b9ba0021-324c-4569-b0f6-14c5903d1d11 req-c7d63c72-8664-4631-8abb-30b03b095737 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086523 Jun 16 18:31:44.869857 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 164/354] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Jun 16 18:31:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:31:44.878765 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-85565d58-faa2-4894-a028-c33e44167b87 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ac8d9846-c3c7-4424-bdae-2da3c1c9214a"}} {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:31:44.879927 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-85565d58-faa2-4894-a028-c33e44167b87 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] [instance: 651b5fe1-0df7-4bc6-b18e-7caea544a93f] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:31:44.888013 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-85565d58-faa2-4894-a028-c33e44167b87 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:44.888505 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-85565d58-faa2-4894-a028-c33e44167b87 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:44.889462 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-85565d58-faa2-4894-a028-c33e44167b87 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:44.890046 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-85565d58-faa2-4894-a028-c33e44167b87 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:45.048691 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-6d0938f1-2834-4efc-b2b1-4fafde21eb94 tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:31:45.050302 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-6d0938f1-2834-4efc-b2b1-4fafde21eb94 tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] [instance: 26fdb428-7e41-4e0f-b91a-15009844089f] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:31:45.066939 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG dbcounter [-] [117671] Writing DB stats nova_cell0:SELECT=2 {{(pid=117671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:31:45.076415 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-6d0938f1-2834-4efc-b2b1-4fafde21eb94 tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:45.077252 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-6d0938f1-2834-4efc-b2b1-4fafde21eb94 tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:45.078182 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-6d0938f1-2834-4efc-b2b1-4fafde21eb94 tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:45.078714 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-6d0938f1-2834-4efc-b2b1-4fafde21eb94 tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:45.130808 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG dbcounter [-] [117671] Writing DB stats nova_cell0:SELECT=6 {{(pid=117671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:31:45.333572 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-6d0938f1-2834-4efc-b2b1-4fafde21eb94 tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7d57c4231b49b28a606a17e42267e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9fa2caa1412451aa0308c807d5c62d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:31:45.347983 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-6d0938f1-2834-4efc-b2b1-4fafde21eb94 tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] 10.222.0.30 "GET /compute/v2.1/servers/26fdb428-7e41-4e0f-b91a-15009844089f" status: 200 len: 1359 microversion: 2.1 time: 0.314241 Jun 16 18:31:45.349026 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 165/355] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:31:45 2022] GET /compute/v2.1/servers/26fdb428-7e41-4e0f-b91a-15009844089f => generated 1359 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:31:45.413256 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG dbcounter [-] [117670] Writing DB stats nova_cell0:SELECT=2 {{(pid=117670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:31:45.421524 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-85565d58-faa2-4894-a028-c33e44167b87 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] 10.222.0.30 "POST /compute/v2.1/servers/651b5fe1-0df7-4bc6-b18e-7caea544a93f/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.546345 Jun 16 18:31:45.424086 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 191/356] 10.222.0.30 () {62 vars in 1363 bytes} [Thu Jun 16 18:31:44 2022] POST /compute/v2.1/servers/651b5fe1-0df7-4bc6-b18e-7caea544a93f/os-volume_attachments => generated 188 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 18:31:45.440270 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-0ce6c7dc-6122-4e9c-8798-4219eaa2f54a tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:31:45.440893 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-0ce6c7dc-6122-4e9c-8798-4219eaa2f54a tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] [instance: e10b3f49-1ff3-474c-833b-b83e3300e617] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:31:45.448079 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-0ce6c7dc-6122-4e9c-8798-4219eaa2f54a tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:45.448526 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-0ce6c7dc-6122-4e9c-8798-4219eaa2f54a tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:45.449334 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-0ce6c7dc-6122-4e9c-8798-4219eaa2f54a tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:45.449779 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-0ce6c7dc-6122-4e9c-8798-4219eaa2f54a tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:45.576368 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-758ea54b-784e-4a8c-ab54-247cbc71f5ec tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:31:45.577480 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-758ea54b-784e-4a8c-ab54-247cbc71f5ec tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] [instance: 651b5fe1-0df7-4bc6-b18e-7caea544a93f] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:31:45.585392 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-758ea54b-784e-4a8c-ab54-247cbc71f5ec tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:45.585835 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-758ea54b-784e-4a8c-ab54-247cbc71f5ec tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:45.588205 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-758ea54b-784e-4a8c-ab54-247cbc71f5ec tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:45.588852 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-758ea54b-784e-4a8c-ab54-247cbc71f5ec tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:45.621510 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-0ce6c7dc-6122-4e9c-8798-4219eaa2f54a tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512f01cca14b447c8f6c9eebbd828eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70bbccf07e3404cb94ba59201061a6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:31:45.643496 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-0ce6c7dc-6122-4e9c-8798-4219eaa2f54a tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] 10.222.0.30 "GET /compute/v2.1/servers/e10b3f49-1ff3-474c-833b-b83e3300e617" status: 200 len: 1371 microversion: 2.1 time: 0.206633 Jun 16 18:31:45.644598 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 166/357] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:31:45 2022] GET /compute/v2.1/servers/e10b3f49-1ff3-474c-833b-b83e3300e617 => generated 1371 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:31:45.747733 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-758ea54b-784e-4a8c-ab54-247cbc71f5ec tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] 10.222.0.30 "POST /compute/v2.1/servers/651b5fe1-0df7-4bc6-b18e-7caea544a93f/action" status: 202 len: 0 microversion: 2.20 time: 0.181809 Jun 16 18:31:45.748920 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 192/358] 10.222.0.30 () {62 vars in 1318 bytes} [Thu Jun 16 18:31:45 2022] POST /compute/v2.1/servers/651b5fe1-0df7-4bc6-b18e-7caea544a93f/action => generated 0 bytes in 184 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jun 16 18:31:45.761936 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-9cff0bf3-d667-4259-bef9-2d6b463cbc82 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:31:45.763057 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-9cff0bf3-d667-4259-bef9-2d6b463cbc82 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] [instance: 651b5fe1-0df7-4bc6-b18e-7caea544a93f] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:31:45.775092 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-9cff0bf3-d667-4259-bef9-2d6b463cbc82 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:45.775887 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-9cff0bf3-d667-4259-bef9-2d6b463cbc82 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:45.778040 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-9cff0bf3-d667-4259-bef9-2d6b463cbc82 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:45.779085 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-9cff0bf3-d667-4259-bef9-2d6b463cbc82 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:46.057335 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-9cff0bf3-d667-4259-bef9-2d6b463cbc82 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:31:46.068093 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-9cff0bf3-d667-4259-bef9-2d6b463cbc82 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:31:46.069771 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-9cff0bf3-d667-4259-bef9-2d6b463cbc82 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:31:46.071753 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-9cff0bf3-d667-4259-bef9-2d6b463cbc82 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] 10.222.0.30 "GET /compute/v2.1/servers/651b5fe1-0df7-4bc6-b18e-7caea544a93f" status: 200 len: 1751 microversion: 2.20 time: 0.317734 Jun 16 18:31:46.072471 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 167/359] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Jun 16 18:31:45 2022] GET /compute/v2.1/servers/651b5fe1-0df7-4bc6-b18e-7caea544a93f => generated 1751 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:31:46.375004 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-58a78ad0-20c1-4941-95e0-472ad39591b2 tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:31:46.376220 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-58a78ad0-20c1-4941-95e0-472ad39591b2 tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] [instance: 26fdb428-7e41-4e0f-b91a-15009844089f] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:31:46.388859 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-58a78ad0-20c1-4941-95e0-472ad39591b2 tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:46.390832 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-58a78ad0-20c1-4941-95e0-472ad39591b2 tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:46.392489 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-58a78ad0-20c1-4941-95e0-472ad39591b2 tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:46.393359 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-58a78ad0-20c1-4941-95e0-472ad39591b2 tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:46.670076 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-4e0d62b2-bbd6-4bd4-8fb0-631b6ed7fded tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:31:46.670963 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-4e0d62b2-bbd6-4bd4-8fb0-631b6ed7fded tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] [instance: e10b3f49-1ff3-474c-833b-b83e3300e617] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:31:46.679179 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-4e0d62b2-bbd6-4bd4-8fb0-631b6ed7fded tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:46.679797 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-4e0d62b2-bbd6-4bd4-8fb0-631b6ed7fded tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:46.681118 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-4e0d62b2-bbd6-4bd4-8fb0-631b6ed7fded tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:46.681842 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-4e0d62b2-bbd6-4bd4-8fb0-631b6ed7fded tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:46.692988 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-58a78ad0-20c1-4941-95e0-472ad39591b2 tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7d57c4231b49b28a606a17e42267e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9fa2caa1412451aa0308c807d5c62d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:31:46.707010 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-58a78ad0-20c1-4941-95e0-472ad39591b2 tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] 10.222.0.30 "GET /compute/v2.1/servers/26fdb428-7e41-4e0f-b91a-15009844089f" status: 200 len: 1359 microversion: 2.1 time: 0.341446 Jun 16 18:31:46.707980 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 193/360] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:31:46 2022] GET /compute/v2.1/servers/26fdb428-7e41-4e0f-b91a-15009844089f => generated 1359 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:31:46.890709 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-4e0d62b2-bbd6-4bd4-8fb0-631b6ed7fded tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512f01cca14b447c8f6c9eebbd828eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70bbccf07e3404cb94ba59201061a6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:31:46.905709 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-4e0d62b2-bbd6-4bd4-8fb0-631b6ed7fded tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] 10.222.0.30 "GET /compute/v2.1/servers/e10b3f49-1ff3-474c-833b-b83e3300e617" status: 200 len: 1371 microversion: 2.1 time: 0.239199 Jun 16 18:31:46.906886 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 168/361] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:31:46 2022] GET /compute/v2.1/servers/e10b3f49-1ff3-474c-833b-b83e3300e617 => generated 1371 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:31:47.092571 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-ba876ba8-4609-43a6-ad99-9c9b3cdcccef tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:31:47.093452 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-ba876ba8-4609-43a6-ad99-9c9b3cdcccef tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] [instance: 651b5fe1-0df7-4bc6-b18e-7caea544a93f] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:31:47.103350 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-ba876ba8-4609-43a6-ad99-9c9b3cdcccef tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:47.104297 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-ba876ba8-4609-43a6-ad99-9c9b3cdcccef tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:47.105294 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-ba876ba8-4609-43a6-ad99-9c9b3cdcccef tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:47.105910 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-ba876ba8-4609-43a6-ad99-9c9b3cdcccef tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:47.342376 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-ba876ba8-4609-43a6-ad99-9c9b3cdcccef tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:31:47.351117 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-ba876ba8-4609-43a6-ad99-9c9b3cdcccef tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:31:47.352927 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-ba876ba8-4609-43a6-ad99-9c9b3cdcccef tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:31:47.354126 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-ba876ba8-4609-43a6-ad99-9c9b3cdcccef tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] 10.222.0.30 "GET /compute/v2.1/servers/651b5fe1-0df7-4bc6-b18e-7caea544a93f" status: 200 len: 1751 microversion: 2.20 time: 0.266515 Jun 16 18:31:47.354689 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 194/362] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Jun 16 18:31:47 2022] GET /compute/v2.1/servers/651b5fe1-0df7-4bc6-b18e-7caea544a93f => generated 1751 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:31:47.739588 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-ddc622c1-5006-42e3-a986-5decda4a833c tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:31:47.740765 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-ddc622c1-5006-42e3-a986-5decda4a833c tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] [instance: 26fdb428-7e41-4e0f-b91a-15009844089f] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:31:47.755469 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-ddc622c1-5006-42e3-a986-5decda4a833c tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:47.757325 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-ddc622c1-5006-42e3-a986-5decda4a833c tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:47.758892 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-ddc622c1-5006-42e3-a986-5decda4a833c tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:47.759703 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-ddc622c1-5006-42e3-a986-5decda4a833c tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:47.947616 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-b72258db-8a5f-407f-9bde-f6ac297a0c15 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:31:47.948695 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-b72258db-8a5f-407f-9bde-f6ac297a0c15 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] [instance: e10b3f49-1ff3-474c-833b-b83e3300e617] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:31:47.959245 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-b72258db-8a5f-407f-9bde-f6ac297a0c15 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:47.959688 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-b72258db-8a5f-407f-9bde-f6ac297a0c15 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:47.960501 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-b72258db-8a5f-407f-9bde-f6ac297a0c15 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:47.961075 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-b72258db-8a5f-407f-9bde-f6ac297a0c15 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:47.990836 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-ddc622c1-5006-42e3-a986-5decda4a833c tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7d57c4231b49b28a606a17e42267e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9fa2caa1412451aa0308c807d5c62d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:31:48.025732 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-ddc622c1-5006-42e3-a986-5decda4a833c tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] 10.222.0.30 "GET /compute/v2.1/servers/26fdb428-7e41-4e0f-b91a-15009844089f" status: 200 len: 1549 microversion: 2.1 time: 0.293242 Jun 16 18:31:48.041375 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 169/363] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:31:47 2022] GET /compute/v2.1/servers/26fdb428-7e41-4e0f-b91a-15009844089f => generated 1549 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:31:48.063324 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-b982840e-3b73-45a8-829a-22c716ef854d tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:31:48.064745 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-b982840e-3b73-45a8-829a-22c716ef854d tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] [instance: 26fdb428-7e41-4e0f-b91a-15009844089f] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:31:48.077662 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-b982840e-3b73-45a8-829a-22c716ef854d tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:48.078623 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-b982840e-3b73-45a8-829a-22c716ef854d tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:48.080950 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-b982840e-3b73-45a8-829a-22c716ef854d tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:48.081792 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-b982840e-3b73-45a8-829a-22c716ef854d tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:48.121171 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG dbcounter [-] [117671] Writing DB stats nova_cell1:SELECT=100 {{(pid=117671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:31:48.221294 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-b72258db-8a5f-407f-9bde-f6ac297a0c15 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512f01cca14b447c8f6c9eebbd828eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70bbccf07e3404cb94ba59201061a6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:31:48.232866 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-b72258db-8a5f-407f-9bde-f6ac297a0c15 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] 10.222.0.30 "GET /compute/v2.1/servers/e10b3f49-1ff3-474c-833b-b83e3300e617" status: 200 len: 1371 microversion: 2.1 time: 0.305347 Jun 16 18:31:48.235471 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 195/364] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:31:47 2022] GET /compute/v2.1/servers/e10b3f49-1ff3-474c-833b-b83e3300e617 => generated 1371 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:31:48.382631 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-517ce496-ff6c-4f76-a6e5-85f8f79e46f8 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:31:48.383551 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-b982840e-3b73-45a8-829a-22c716ef854d tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7d57c4231b49b28a606a17e42267e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9fa2caa1412451aa0308c807d5c62d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:31:48.384448 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-517ce496-ff6c-4f76-a6e5-85f8f79e46f8 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] [instance: 651b5fe1-0df7-4bc6-b18e-7caea544a93f] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:31:48.402226 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-517ce496-ff6c-4f76-a6e5-85f8f79e46f8 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:48.402458 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-b982840e-3b73-45a8-829a-22c716ef854d tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] 10.222.0.30 "GET /compute/v2.1/servers/26fdb428-7e41-4e0f-b91a-15009844089f" status: 200 len: 1549 microversion: 2.1 time: 0.351951 Jun 16 18:31:48.403370 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-517ce496-ff6c-4f76-a6e5-85f8f79e46f8 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:48.405191 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-517ce496-ff6c-4f76-a6e5-85f8f79e46f8 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:48.406299 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-517ce496-ff6c-4f76-a6e5-85f8f79e46f8 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:48.423641 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 170/365] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:31:48 2022] GET /compute/v2.1/servers/26fdb428-7e41-4e0f-b91a-15009844089f => generated 1549 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:31:48.450743 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-fe69b4c3-4249-44cc-8c5e-ae4fb322e7c8 tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:31:48.457192 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-fe69b4c3-4249-44cc-8c5e-ae4fb322e7c8 tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0d7d57c4231b49b28a606a17e42267e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9fa2caa1412451aa0308c807d5c62d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:31:48.458248 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-fe69b4c3-4249-44cc-8c5e-ae4fb322e7c8 tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Searching by: {'deleted': False, 'project_id': 'c9fa2caa1412451aa0308c807d5c62d8'} {{(pid=117671) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 16 18:31:48.467974 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-fe69b4c3-4249-44cc-8c5e-ae4fb322e7c8 tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:48.468465 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-fe69b4c3-4249-44cc-8c5e-ae4fb322e7c8 tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:48.469350 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-fe69b4c3-4249-44cc-8c5e-ae4fb322e7c8 tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:48.469797 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-fe69b4c3-4249-44cc-8c5e-ae4fb322e7c8 tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:48.603623 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.multi_cell_list [None req-fe69b4c3-4249-44cc-8c5e-ae4fb322e7c8 tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=117671) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 16 18:31:48.682387 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-517ce496-ff6c-4f76-a6e5-85f8f79e46f8 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:31:48.694609 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-517ce496-ff6c-4f76-a6e5-85f8f79e46f8 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:31:48.702824 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-517ce496-ff6c-4f76-a6e5-85f8f79e46f8 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:31:48.704460 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-517ce496-ff6c-4f76-a6e5-85f8f79e46f8 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] 10.222.0.30 "GET /compute/v2.1/servers/651b5fe1-0df7-4bc6-b18e-7caea544a93f" status: 200 len: 1753 microversion: 2.20 time: 0.326931 Jun 16 18:31:48.705037 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 196/366] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Jun 16 18:31:48 2022] GET /compute/v2.1/servers/651b5fe1-0df7-4bc6-b18e-7caea544a93f => generated 1753 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:31:48.770883 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-fe69b4c3-4249-44cc-8c5e-ae4fb322e7c8 tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] 10.222.0.30 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.345490 Jun 16 18:31:48.771542 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 171/367] 10.222.0.30 () {58 vars in 1124 bytes} [Thu Jun 16 18:31:48 2022] GET /compute/v2.1/servers => generated 343 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:31:48.784265 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-79c32c9c-c1db-4b22-84ea-c16b33f412f9 tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:31:48.785143 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-79c32c9c-c1db-4b22-84ea-c16b33f412f9 tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] [instance: 26fdb428-7e41-4e0f-b91a-15009844089f] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:31:48.793518 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-79c32c9c-c1db-4b22-84ea-c16b33f412f9 tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:48.794066 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-79c32c9c-c1db-4b22-84ea-c16b33f412f9 tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:48.795172 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-79c32c9c-c1db-4b22-84ea-c16b33f412f9 tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:48.795862 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-79c32c9c-c1db-4b22-84ea-c16b33f412f9 tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:49.029173 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-79c32c9c-c1db-4b22-84ea-c16b33f412f9 tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7d57c4231b49b28a606a17e42267e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9fa2caa1412451aa0308c807d5c62d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:31:49.037069 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-79c32c9c-c1db-4b22-84ea-c16b33f412f9 tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] 10.222.0.30 "GET /compute/v2.1/servers/26fdb428-7e41-4e0f-b91a-15009844089f" status: 200 len: 1549 microversion: 2.1 time: 0.257268 Jun 16 18:31:49.037660 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 197/368] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:31:48 2022] GET /compute/v2.1/servers/26fdb428-7e41-4e0f-b91a-15009844089f => generated 1549 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:31:49.272099 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-5713d81e-ef60-4a75-ae96-5ad5f37f17dc tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:31:49.273928 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-5713d81e-ef60-4a75-ae96-5ad5f37f17dc tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] [instance: e10b3f49-1ff3-474c-833b-b83e3300e617] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:31:49.290661 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-5713d81e-ef60-4a75-ae96-5ad5f37f17dc tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:49.292090 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-5713d81e-ef60-4a75-ae96-5ad5f37f17dc tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:49.294852 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-5713d81e-ef60-4a75-ae96-5ad5f37f17dc tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:49.296611 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-5713d81e-ef60-4a75-ae96-5ad5f37f17dc tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:49.540277 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-5713d81e-ef60-4a75-ae96-5ad5f37f17dc tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512f01cca14b447c8f6c9eebbd828eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70bbccf07e3404cb94ba59201061a6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:31:49.551912 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-5713d81e-ef60-4a75-ae96-5ad5f37f17dc tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] 10.222.0.30 "GET /compute/v2.1/servers/e10b3f49-1ff3-474c-833b-b83e3300e617" status: 200 len: 1371 microversion: 2.1 time: 0.286865 Jun 16 18:31:49.557757 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 172/369] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:31:49 2022] GET /compute/v2.1/servers/e10b3f49-1ff3-474c-833b-b83e3300e617 => generated 1371 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:31:49.726300 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-a8768030-6317-44c7-871b-501d5d7fba8e tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:31:49.728195 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-a8768030-6317-44c7-871b-501d5d7fba8e tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] [instance: 651b5fe1-0df7-4bc6-b18e-7caea544a93f] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:31:49.734648 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-a8768030-6317-44c7-871b-501d5d7fba8e tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:49.735104 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-a8768030-6317-44c7-871b-501d5d7fba8e tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:49.736086 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-a8768030-6317-44c7-871b-501d5d7fba8e tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:49.736345 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-a8768030-6317-44c7-871b-501d5d7fba8e tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:49.979926 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-a8768030-6317-44c7-871b-501d5d7fba8e tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:31:49.993201 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-a8768030-6317-44c7-871b-501d5d7fba8e tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:31:49.994846 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-a8768030-6317-44c7-871b-501d5d7fba8e tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:31:49.996263 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-a8768030-6317-44c7-871b-501d5d7fba8e tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] 10.222.0.30 "GET /compute/v2.1/servers/651b5fe1-0df7-4bc6-b18e-7caea544a93f" status: 200 len: 1809 microversion: 2.20 time: 0.273794 Jun 16 18:31:49.996641 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 198/370] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Jun 16 18:31:49 2022] GET /compute/v2.1/servers/651b5fe1-0df7-4bc6-b18e-7caea544a93f => generated 1809 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 18:31:50.239482 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [req-7270a1c4-2b64-4474-b436-3a9fcf19dced req-049d7f86-8a6c-4c0e-9863-5d0ade43325f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e10b3f49-1ff3-474c-833b-b83e3300e617", "name": "network-vif-plugged", "status": "completed", "tag": "415b1820-aec4-49ee-8ec3-7e34692c9dc5"}]} {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:31:50.249998 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [req-7270a1c4-2b64-4474-b436-3a9fcf19dced req-049d7f86-8a6c-4c0e-9863-5d0ade43325f service nova] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:50.250537 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [req-7270a1c4-2b64-4474-b436-3a9fcf19dced req-049d7f86-8a6c-4c0e-9863-5d0ade43325f service nova] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:50.263002 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.compute.server_external_events [req-7270a1c4-2b64-4474-b436-3a9fcf19dced req-049d7f86-8a6c-4c0e-9863-5d0ade43325f service nova] Creating event network-vif-plugged:415b1820-aec4-49ee-8ec3-7e34692c9dc5 for instance e10b3f49-1ff3-474c-833b-b83e3300e617 on hv-cinder-81322 Jun 16 18:31:50.268247 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [req-7270a1c4-2b64-4474-b436-3a9fcf19dced req-049d7f86-8a6c-4c0e-9863-5d0ade43325f service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032423 Jun 16 18:31:50.269033 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 173/371] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Jun 16 18:31:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:31:50.573693 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-3d25d2b3-c64c-4042-8c4a-cb9170f653f9 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:31:50.574822 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-3d25d2b3-c64c-4042-8c4a-cb9170f653f9 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] [instance: e10b3f49-1ff3-474c-833b-b83e3300e617] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:31:50.597190 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-3d25d2b3-c64c-4042-8c4a-cb9170f653f9 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:50.598473 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-3d25d2b3-c64c-4042-8c4a-cb9170f653f9 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:50.600036 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-3d25d2b3-c64c-4042-8c4a-cb9170f653f9 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:50.600933 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-3d25d2b3-c64c-4042-8c4a-cb9170f653f9 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:50.793786 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-3d25d2b3-c64c-4042-8c4a-cb9170f653f9 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512f01cca14b447c8f6c9eebbd828eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70bbccf07e3404cb94ba59201061a6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:31:50.803813 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-3d25d2b3-c64c-4042-8c4a-cb9170f653f9 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] 10.222.0.30 "GET /compute/v2.1/servers/e10b3f49-1ff3-474c-833b-b83e3300e617" status: 200 len: 1371 microversion: 2.1 time: 0.234330 Jun 16 18:31:50.807076 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 199/372] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:31:50 2022] GET /compute/v2.1/servers/e10b3f49-1ff3-474c-833b-b83e3300e617 => generated 1371 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:31:50.880798 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-2bef0c49-a2fb-4216-896d-33d57dceca47 tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "622a80ea-7379-4123-84e6-95a50efb3b40"}} {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:31:50.881970 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-2bef0c49-a2fb-4216-896d-33d57dceca47 tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] [instance: 26fdb428-7e41-4e0f-b91a-15009844089f] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:31:50.892038 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-2bef0c49-a2fb-4216-896d-33d57dceca47 tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:50.892523 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-2bef0c49-a2fb-4216-896d-33d57dceca47 tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:50.893311 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-2bef0c49-a2fb-4216-896d-33d57dceca47 tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:50.893754 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-2bef0c49-a2fb-4216-896d-33d57dceca47 tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:51.020664 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-8b18bb62-c6e0-4925-bc12-ddbe0d127ac4 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:31:51.021802 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-8b18bb62-c6e0-4925-bc12-ddbe0d127ac4 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] [instance: 651b5fe1-0df7-4bc6-b18e-7caea544a93f] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:31:51.036863 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-8b18bb62-c6e0-4925-bc12-ddbe0d127ac4 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:51.038213 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-8b18bb62-c6e0-4925-bc12-ddbe0d127ac4 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:51.040322 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-8b18bb62-c6e0-4925-bc12-ddbe0d127ac4 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:51.041640 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-8b18bb62-c6e0-4925-bc12-ddbe0d127ac4 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:51.110856 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG dbcounter [-] [117670] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=117670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:31:51.299870 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-8b18bb62-c6e0-4925-bc12-ddbe0d127ac4 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:31:51.327763 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-8b18bb62-c6e0-4925-bc12-ddbe0d127ac4 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:31:51.341648 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-8b18bb62-c6e0-4925-bc12-ddbe0d127ac4 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:31:51.345378 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-8b18bb62-c6e0-4925-bc12-ddbe0d127ac4 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] 10.222.0.30 "GET /compute/v2.1/servers/651b5fe1-0df7-4bc6-b18e-7caea544a93f" status: 200 len: 1809 microversion: 2.20 time: 0.332695 Jun 16 18:31:51.365882 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 200/373] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Jun 16 18:31:51 2022] GET /compute/v2.1/servers/651b5fe1-0df7-4bc6-b18e-7caea544a93f => generated 1809 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 18:31:51.831596 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-55dcdd29-2002-433c-853c-751b5ad06092 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:31:51.832432 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-55dcdd29-2002-433c-853c-751b5ad06092 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] [instance: e10b3f49-1ff3-474c-833b-b83e3300e617] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:31:51.841315 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-55dcdd29-2002-433c-853c-751b5ad06092 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:51.841828 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-55dcdd29-2002-433c-853c-751b5ad06092 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:51.843647 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-55dcdd29-2002-433c-853c-751b5ad06092 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:51.843647 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-55dcdd29-2002-433c-853c-751b5ad06092 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:52.094067 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-55dcdd29-2002-433c-853c-751b5ad06092 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512f01cca14b447c8f6c9eebbd828eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70bbccf07e3404cb94ba59201061a6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:31:52.103415 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-55dcdd29-2002-433c-853c-751b5ad06092 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] 10.222.0.30 "GET /compute/v2.1/servers/e10b3f49-1ff3-474c-833b-b83e3300e617" status: 200 len: 1371 microversion: 2.1 time: 0.275862 Jun 16 18:31:52.104339 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 201/374] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:31:51 2022] GET /compute/v2.1/servers/e10b3f49-1ff3-474c-833b-b83e3300e617 => generated 1371 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:31:52.378362 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-d7b79bb2-091d-4189-9538-04903eea7218 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:31:52.381526 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-d7b79bb2-091d-4189-9538-04903eea7218 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] [instance: 651b5fe1-0df7-4bc6-b18e-7caea544a93f] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:31:52.407505 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-d7b79bb2-091d-4189-9538-04903eea7218 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:52.410343 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-d7b79bb2-091d-4189-9538-04903eea7218 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:52.412221 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-d7b79bb2-091d-4189-9538-04903eea7218 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:52.413284 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-d7b79bb2-091d-4189-9538-04903eea7218 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:52.673014 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-d7b79bb2-091d-4189-9538-04903eea7218 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:31:52.697318 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-d7b79bb2-091d-4189-9538-04903eea7218 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:31:52.700803 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-d7b79bb2-091d-4189-9538-04903eea7218 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:31:52.703183 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-d7b79bb2-091d-4189-9538-04903eea7218 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] 10.222.0.30 "GET /compute/v2.1/servers/651b5fe1-0df7-4bc6-b18e-7caea544a93f" status: 200 len: 1809 microversion: 2.20 time: 0.332673 Jun 16 18:31:52.704425 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 202/375] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Jun 16 18:31:52 2022] GET /compute/v2.1/servers/651b5fe1-0df7-4bc6-b18e-7caea544a93f => generated 1809 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:31:53.128759 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-706f5732-d3eb-4af6-8d98-b3bf44ca41c9 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:31:53.130700 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-706f5732-d3eb-4af6-8d98-b3bf44ca41c9 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] [instance: e10b3f49-1ff3-474c-833b-b83e3300e617] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:31:53.140416 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-706f5732-d3eb-4af6-8d98-b3bf44ca41c9 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:53.141232 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-706f5732-d3eb-4af6-8d98-b3bf44ca41c9 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:53.142379 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-706f5732-d3eb-4af6-8d98-b3bf44ca41c9 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:53.143454 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-706f5732-d3eb-4af6-8d98-b3bf44ca41c9 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:53.350778 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-706f5732-d3eb-4af6-8d98-b3bf44ca41c9 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512f01cca14b447c8f6c9eebbd828eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70bbccf07e3404cb94ba59201061a6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:31:53.360303 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-706f5732-d3eb-4af6-8d98-b3bf44ca41c9 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] 10.222.0.30 "GET /compute/v2.1/servers/e10b3f49-1ff3-474c-833b-b83e3300e617" status: 200 len: 1371 microversion: 2.1 time: 0.235490 Jun 16 18:31:53.360890 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 203/376] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:31:53 2022] GET /compute/v2.1/servers/e10b3f49-1ff3-474c-833b-b83e3300e617 => generated 1371 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:31:53.736621 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-6f62fcb0-577f-426a-bc0a-e2bd72ee2f1c tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:31:53.737629 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-6f62fcb0-577f-426a-bc0a-e2bd72ee2f1c tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] [instance: 651b5fe1-0df7-4bc6-b18e-7caea544a93f] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:31:53.749864 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-6f62fcb0-577f-426a-bc0a-e2bd72ee2f1c tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:53.750485 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-6f62fcb0-577f-426a-bc0a-e2bd72ee2f1c tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:53.751722 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-6f62fcb0-577f-426a-bc0a-e2bd72ee2f1c tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:53.752563 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-6f62fcb0-577f-426a-bc0a-e2bd72ee2f1c tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:53.954797 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-6f62fcb0-577f-426a-bc0a-e2bd72ee2f1c tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:31:53.966958 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-6f62fcb0-577f-426a-bc0a-e2bd72ee2f1c tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:31:53.968908 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-6f62fcb0-577f-426a-bc0a-e2bd72ee2f1c tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:31:53.971186 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-6f62fcb0-577f-426a-bc0a-e2bd72ee2f1c tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] 10.222.0.30 "GET /compute/v2.1/servers/651b5fe1-0df7-4bc6-b18e-7caea544a93f" status: 200 len: 1809 microversion: 2.20 time: 0.239855 Jun 16 18:31:53.973476 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 204/377] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Jun 16 18:31:53 2022] GET /compute/v2.1/servers/651b5fe1-0df7-4bc6-b18e-7caea544a93f => generated 1809 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:31:54.393688 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-418cf8e1-d9ec-4f1f-bb73-40ff5e343c04 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:31:54.394838 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-418cf8e1-d9ec-4f1f-bb73-40ff5e343c04 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] [instance: e10b3f49-1ff3-474c-833b-b83e3300e617] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:31:54.406873 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-418cf8e1-d9ec-4f1f-bb73-40ff5e343c04 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:54.407588 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-418cf8e1-d9ec-4f1f-bb73-40ff5e343c04 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:54.408613 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-418cf8e1-d9ec-4f1f-bb73-40ff5e343c04 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:54.409097 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-418cf8e1-d9ec-4f1f-bb73-40ff5e343c04 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:54.623779 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-418cf8e1-d9ec-4f1f-bb73-40ff5e343c04 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512f01cca14b447c8f6c9eebbd828eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70bbccf07e3404cb94ba59201061a6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:31:54.632146 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-418cf8e1-d9ec-4f1f-bb73-40ff5e343c04 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] 10.222.0.30 "GET /compute/v2.1/servers/e10b3f49-1ff3-474c-833b-b83e3300e617" status: 200 len: 1371 microversion: 2.1 time: 0.246952 Jun 16 18:31:54.639674 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 205/378] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:31:54 2022] GET /compute/v2.1/servers/e10b3f49-1ff3-474c-833b-b83e3300e617 => generated 1371 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:31:54.993356 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-334f9415-39f1-49c0-88e8-42f12ce5fe4f tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:31:54.994072 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-334f9415-39f1-49c0-88e8-42f12ce5fe4f tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] [instance: 651b5fe1-0df7-4bc6-b18e-7caea544a93f] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:31:55.000923 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-334f9415-39f1-49c0-88e8-42f12ce5fe4f tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:55.001372 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-334f9415-39f1-49c0-88e8-42f12ce5fe4f tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:55.002171 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-334f9415-39f1-49c0-88e8-42f12ce5fe4f tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:55.002632 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-334f9415-39f1-49c0-88e8-42f12ce5fe4f tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:55.225619 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-334f9415-39f1-49c0-88e8-42f12ce5fe4f tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:31:55.235235 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-334f9415-39f1-49c0-88e8-42f12ce5fe4f tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:31:55.236983 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-334f9415-39f1-49c0-88e8-42f12ce5fe4f tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:31:55.238123 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-334f9415-39f1-49c0-88e8-42f12ce5fe4f tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] 10.222.0.30 "GET /compute/v2.1/servers/651b5fe1-0df7-4bc6-b18e-7caea544a93f" status: 200 len: 1809 microversion: 2.20 time: 0.249163 Jun 16 18:31:55.238699 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 206/379] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Jun 16 18:31:54 2022] GET /compute/v2.1/servers/651b5fe1-0df7-4bc6-b18e-7caea544a93f => generated 1809 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 18:31:55.651474 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-98b5823b-8df9-4f64-a802-eb3298912072 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:31:55.653070 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-98b5823b-8df9-4f64-a802-eb3298912072 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] [instance: e10b3f49-1ff3-474c-833b-b83e3300e617] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:31:55.666275 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-98b5823b-8df9-4f64-a802-eb3298912072 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:55.667558 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-98b5823b-8df9-4f64-a802-eb3298912072 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:55.670197 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-98b5823b-8df9-4f64-a802-eb3298912072 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:55.671114 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-98b5823b-8df9-4f64-a802-eb3298912072 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:55.882274 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-98b5823b-8df9-4f64-a802-eb3298912072 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512f01cca14b447c8f6c9eebbd828eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70bbccf07e3404cb94ba59201061a6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:31:55.912878 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-98b5823b-8df9-4f64-a802-eb3298912072 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] 10.222.0.30 "GET /compute/v2.1/servers/e10b3f49-1ff3-474c-833b-b83e3300e617" status: 200 len: 1371 microversion: 2.1 time: 0.265281 Jun 16 18:31:55.915499 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 207/380] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:31:55 2022] GET /compute/v2.1/servers/e10b3f49-1ff3-474c-833b-b83e3300e617 => generated 1371 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:31:56.295256 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-1f3e7d41-f030-4ad5-872d-9556869beb0e tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:31:56.300801 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-1f3e7d41-f030-4ad5-872d-9556869beb0e tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] [instance: 651b5fe1-0df7-4bc6-b18e-7caea544a93f] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:31:56.314307 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-1f3e7d41-f030-4ad5-872d-9556869beb0e tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:56.315183 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-1f3e7d41-f030-4ad5-872d-9556869beb0e tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:56.316877 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-1f3e7d41-f030-4ad5-872d-9556869beb0e tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:56.317319 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-1f3e7d41-f030-4ad5-872d-9556869beb0e tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:56.517145 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-1f3e7d41-f030-4ad5-872d-9556869beb0e tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:31:56.527712 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-1f3e7d41-f030-4ad5-872d-9556869beb0e tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:31:56.529701 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-1f3e7d41-f030-4ad5-872d-9556869beb0e tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:31:56.531124 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-1f3e7d41-f030-4ad5-872d-9556869beb0e tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] 10.222.0.30 "GET /compute/v2.1/servers/651b5fe1-0df7-4bc6-b18e-7caea544a93f" status: 200 len: 1809 microversion: 2.20 time: 0.271004 Jun 16 18:31:56.532099 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 208/381] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Jun 16 18:31:56 2022] GET /compute/v2.1/servers/651b5fe1-0df7-4bc6-b18e-7caea544a93f => generated 1809 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 18:31:56.950437 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-b7f88ab9-2c38-4877-b437-264b1bdb9edd tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:31:56.952203 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-b7f88ab9-2c38-4877-b437-264b1bdb9edd tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] [instance: e10b3f49-1ff3-474c-833b-b83e3300e617] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:31:56.967059 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-b7f88ab9-2c38-4877-b437-264b1bdb9edd tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:56.967812 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-b7f88ab9-2c38-4877-b437-264b1bdb9edd tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:56.968855 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-b7f88ab9-2c38-4877-b437-264b1bdb9edd tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:56.969745 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-b7f88ab9-2c38-4877-b437-264b1bdb9edd tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:57.258888 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-b7f88ab9-2c38-4877-b437-264b1bdb9edd tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512f01cca14b447c8f6c9eebbd828eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70bbccf07e3404cb94ba59201061a6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:31:57.276559 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-b7f88ab9-2c38-4877-b437-264b1bdb9edd tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] 10.222.0.30 "GET /compute/v2.1/servers/e10b3f49-1ff3-474c-833b-b83e3300e617" status: 200 len: 1371 microversion: 2.1 time: 0.333696 Jun 16 18:31:57.277575 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 209/382] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:31:56 2022] GET /compute/v2.1/servers/e10b3f49-1ff3-474c-833b-b83e3300e617 => generated 1371 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:31:57.556107 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-3597411b-8da2-416d-99eb-edb9ff461b16 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:31:57.557249 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-3597411b-8da2-416d-99eb-edb9ff461b16 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] [instance: 651b5fe1-0df7-4bc6-b18e-7caea544a93f] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:31:57.581633 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-3597411b-8da2-416d-99eb-edb9ff461b16 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:57.582759 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-3597411b-8da2-416d-99eb-edb9ff461b16 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:57.584158 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-3597411b-8da2-416d-99eb-edb9ff461b16 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:57.584853 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-3597411b-8da2-416d-99eb-edb9ff461b16 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:57.869289 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-3597411b-8da2-416d-99eb-edb9ff461b16 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:31:57.878624 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-3597411b-8da2-416d-99eb-edb9ff461b16 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:31:57.880172 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-3597411b-8da2-416d-99eb-edb9ff461b16 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:31:57.881375 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-3597411b-8da2-416d-99eb-edb9ff461b16 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] 10.222.0.30 "GET /compute/v2.1/servers/651b5fe1-0df7-4bc6-b18e-7caea544a93f" status: 200 len: 1809 microversion: 2.20 time: 0.334585 Jun 16 18:31:57.882072 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 210/383] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Jun 16 18:31:57 2022] GET /compute/v2.1/servers/651b5fe1-0df7-4bc6-b18e-7caea544a93f => generated 1809 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:31:58.306189 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-8cccd4b2-4bd6-432f-ad7f-b9a6f4b52459 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:31:58.307369 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-8cccd4b2-4bd6-432f-ad7f-b9a6f4b52459 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] [instance: e10b3f49-1ff3-474c-833b-b83e3300e617] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:31:58.319430 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-8cccd4b2-4bd6-432f-ad7f-b9a6f4b52459 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:58.320925 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-8cccd4b2-4bd6-432f-ad7f-b9a6f4b52459 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:58.322329 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-8cccd4b2-4bd6-432f-ad7f-b9a6f4b52459 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:58.323119 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-8cccd4b2-4bd6-432f-ad7f-b9a6f4b52459 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:58.511558 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-8cccd4b2-4bd6-432f-ad7f-b9a6f4b52459 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512f01cca14b447c8f6c9eebbd828eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70bbccf07e3404cb94ba59201061a6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:31:58.518950 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG dbcounter [-] [117671] Writing DB stats nova_cell0:SELECT=2 {{(pid=117671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:31:58.528876 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-8cccd4b2-4bd6-432f-ad7f-b9a6f4b52459 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] 10.222.0.30 "GET /compute/v2.1/servers/e10b3f49-1ff3-474c-833b-b83e3300e617" status: 200 len: 1371 microversion: 2.1 time: 0.230237 Jun 16 18:31:58.530391 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 211/384] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:31:58 2022] GET /compute/v2.1/servers/e10b3f49-1ff3-474c-833b-b83e3300e617 => generated 1371 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:31:58.910998 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-97f98c43-affb-4b57-801c-ad4c233a19f5 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:31:58.911954 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-97f98c43-affb-4b57-801c-ad4c233a19f5 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] [instance: 651b5fe1-0df7-4bc6-b18e-7caea544a93f] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:31:58.930938 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-97f98c43-affb-4b57-801c-ad4c233a19f5 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:58.931553 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-97f98c43-affb-4b57-801c-ad4c233a19f5 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:58.932410 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-97f98c43-affb-4b57-801c-ad4c233a19f5 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:58.932856 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-97f98c43-affb-4b57-801c-ad4c233a19f5 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:59.133966 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-97f98c43-affb-4b57-801c-ad4c233a19f5 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:31:59.151291 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-97f98c43-affb-4b57-801c-ad4c233a19f5 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:31:59.155923 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-97f98c43-affb-4b57-801c-ad4c233a19f5 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:31:59.157351 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-97f98c43-affb-4b57-801c-ad4c233a19f5 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] 10.222.0.30 "GET /compute/v2.1/servers/651b5fe1-0df7-4bc6-b18e-7caea544a93f" status: 200 len: 1809 microversion: 2.20 time: 0.251004 Jun 16 18:31:59.171180 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 212/385] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Jun 16 18:31:58 2022] GET /compute/v2.1/servers/651b5fe1-0df7-4bc6-b18e-7caea544a93f => generated 1809 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 18:31:59.555771 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-1b6d269c-895b-472e-b1fd-f975fae96d7f tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:31:59.556909 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-1b6d269c-895b-472e-b1fd-f975fae96d7f tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] [instance: e10b3f49-1ff3-474c-833b-b83e3300e617] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:31:59.568115 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-1b6d269c-895b-472e-b1fd-f975fae96d7f tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:59.569396 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-1b6d269c-895b-472e-b1fd-f975fae96d7f tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:59.571853 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-1b6d269c-895b-472e-b1fd-f975fae96d7f tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:31:59.573057 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-1b6d269c-895b-472e-b1fd-f975fae96d7f tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:31:59.793273 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-1b6d269c-895b-472e-b1fd-f975fae96d7f tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512f01cca14b447c8f6c9eebbd828eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70bbccf07e3404cb94ba59201061a6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:31:59.812765 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-1b6d269c-895b-472e-b1fd-f975fae96d7f tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] 10.222.0.30 "GET /compute/v2.1/servers/e10b3f49-1ff3-474c-833b-b83e3300e617" status: 200 len: 1371 microversion: 2.1 time: 0.260638 Jun 16 18:31:59.814347 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 213/386] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:31:59 2022] GET /compute/v2.1/servers/e10b3f49-1ff3-474c-833b-b83e3300e617 => generated 1371 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:32:00.180770 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-7b365e9d-046b-4c8e-bf86-593efe2bd6c7 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:32:00.181799 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-7b365e9d-046b-4c8e-bf86-593efe2bd6c7 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] [instance: 651b5fe1-0df7-4bc6-b18e-7caea544a93f] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:32:00.197581 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-7b365e9d-046b-4c8e-bf86-593efe2bd6c7 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:00.197581 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-7b365e9d-046b-4c8e-bf86-593efe2bd6c7 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:00.199033 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-7b365e9d-046b-4c8e-bf86-593efe2bd6c7 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:00.200309 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-7b365e9d-046b-4c8e-bf86-593efe2bd6c7 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:00.448233 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-7b365e9d-046b-4c8e-bf86-593efe2bd6c7 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:32:00.460382 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-7b365e9d-046b-4c8e-bf86-593efe2bd6c7 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:32:00.463027 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-7b365e9d-046b-4c8e-bf86-593efe2bd6c7 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:32:00.464579 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-7b365e9d-046b-4c8e-bf86-593efe2bd6c7 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] 10.222.0.30 "GET /compute/v2.1/servers/651b5fe1-0df7-4bc6-b18e-7caea544a93f" status: 200 len: 1809 microversion: 2.20 time: 0.290608 Jun 16 18:32:00.476309 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 214/387] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Jun 16 18:32:00 2022] GET /compute/v2.1/servers/651b5fe1-0df7-4bc6-b18e-7caea544a93f => generated 1809 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 18:32:00.846728 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-e45df981-7a11-4828-95ba-37cbd432a963 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:32:00.848427 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-e45df981-7a11-4828-95ba-37cbd432a963 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] [instance: e10b3f49-1ff3-474c-833b-b83e3300e617] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:32:00.857221 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-e45df981-7a11-4828-95ba-37cbd432a963 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:00.857912 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-e45df981-7a11-4828-95ba-37cbd432a963 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:00.859280 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-e45df981-7a11-4828-95ba-37cbd432a963 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:00.859819 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-e45df981-7a11-4828-95ba-37cbd432a963 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:00.888023 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG dbcounter [-] [117671] Writing DB stats nova_api:SELECT=57,nova_api:INSERT=3 {{(pid=117671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:32:01.000424 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG dbcounter [-] [117671] Writing DB stats nova_cell1:SELECT=24 {{(pid=117671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:32:01.048221 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-e45df981-7a11-4828-95ba-37cbd432a963 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512f01cca14b447c8f6c9eebbd828eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70bbccf07e3404cb94ba59201061a6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:32:01.074204 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-e45df981-7a11-4828-95ba-37cbd432a963 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] 10.222.0.30 "GET /compute/v2.1/servers/e10b3f49-1ff3-474c-833b-b83e3300e617" status: 200 len: 1371 microversion: 2.1 time: 0.233508 Jun 16 18:32:01.075321 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 215/388] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:32:00 2022] GET /compute/v2.1/servers/e10b3f49-1ff3-474c-833b-b83e3300e617 => generated 1371 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:32:01.488965 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-05c06c49-f448-4b47-905f-9f1177f730fc tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:32:01.490364 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-05c06c49-f448-4b47-905f-9f1177f730fc tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] [instance: 651b5fe1-0df7-4bc6-b18e-7caea544a93f] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:32:01.501421 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-05c06c49-f448-4b47-905f-9f1177f730fc tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:01.502363 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-05c06c49-f448-4b47-905f-9f1177f730fc tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:01.503830 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-05c06c49-f448-4b47-905f-9f1177f730fc tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:01.504779 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-05c06c49-f448-4b47-905f-9f1177f730fc tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:01.683919 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-05c06c49-f448-4b47-905f-9f1177f730fc tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:32:01.686867 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG dbcounter [-] [117670] Writing DB stats nova_cell1:SELECT=100 {{(pid=117670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:32:01.698174 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-05c06c49-f448-4b47-905f-9f1177f730fc tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:32:01.700606 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-05c06c49-f448-4b47-905f-9f1177f730fc tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:32:01.702175 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-05c06c49-f448-4b47-905f-9f1177f730fc tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] 10.222.0.30 "GET /compute/v2.1/servers/651b5fe1-0df7-4bc6-b18e-7caea544a93f" status: 200 len: 1809 microversion: 2.20 time: 0.220911 Jun 16 18:32:01.703323 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 216/389] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Jun 16 18:32:01 2022] GET /compute/v2.1/servers/651b5fe1-0df7-4bc6-b18e-7caea544a93f => generated 1809 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 18:32:02.108389 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-05e49ec4-969b-4ae6-b3ae-abf61c0f1659 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:32:02.109464 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-05e49ec4-969b-4ae6-b3ae-abf61c0f1659 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] [instance: e10b3f49-1ff3-474c-833b-b83e3300e617] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:32:02.121797 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-05e49ec4-969b-4ae6-b3ae-abf61c0f1659 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:02.122607 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-05e49ec4-969b-4ae6-b3ae-abf61c0f1659 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:02.123934 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-05e49ec4-969b-4ae6-b3ae-abf61c0f1659 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:02.124648 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-05e49ec4-969b-4ae6-b3ae-abf61c0f1659 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:02.307698 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-05e49ec4-969b-4ae6-b3ae-abf61c0f1659 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512f01cca14b447c8f6c9eebbd828eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70bbccf07e3404cb94ba59201061a6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:32:02.321867 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-05e49ec4-969b-4ae6-b3ae-abf61c0f1659 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] 10.222.0.30 "GET /compute/v2.1/servers/e10b3f49-1ff3-474c-833b-b83e3300e617" status: 200 len: 1371 microversion: 2.1 time: 0.222243 Jun 16 18:32:02.322943 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 217/390] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:32:02 2022] GET /compute/v2.1/servers/e10b3f49-1ff3-474c-833b-b83e3300e617 => generated 1371 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:32:02.722381 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-33814a2b-f59f-4682-9bdc-853b58f1ae72 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:32:02.723005 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-33814a2b-f59f-4682-9bdc-853b58f1ae72 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] [instance: 651b5fe1-0df7-4bc6-b18e-7caea544a93f] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:32:02.730125 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-33814a2b-f59f-4682-9bdc-853b58f1ae72 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:02.730576 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-33814a2b-f59f-4682-9bdc-853b58f1ae72 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:02.731364 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-33814a2b-f59f-4682-9bdc-853b58f1ae72 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:02.731803 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-33814a2b-f59f-4682-9bdc-853b58f1ae72 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:02.959013 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-2bef0c49-a2fb-4216-896d-33d57dceca47 tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] 10.222.0.30 "POST /compute/v2.1/servers/26fdb428-7e41-4e0f-b91a-15009844089f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 12.082278 Jun 16 18:32:02.960208 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 174/391] 10.222.0.30 () {60 vars in 1322 bytes} [Thu Jun 16 18:31:50 2022] POST /compute/v2.1/servers/26fdb428-7e41-4e0f-b91a-15009844089f/os-volume_attachments => generated 194 bytes in 12085 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:32:02.963638 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-33814a2b-f59f-4682-9bdc-853b58f1ae72 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:32:02.980882 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-33814a2b-f59f-4682-9bdc-853b58f1ae72 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:32:02.984253 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-33814a2b-f59f-4682-9bdc-853b58f1ae72 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:32:02.986271 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-33814a2b-f59f-4682-9bdc-853b58f1ae72 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] 10.222.0.30 "GET /compute/v2.1/servers/651b5fe1-0df7-4bc6-b18e-7caea544a93f" status: 200 len: 1809 microversion: 2.20 time: 0.267997 Jun 16 18:32:02.987085 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 218/392] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Jun 16 18:32:02 2022] GET /compute/v2.1/servers/651b5fe1-0df7-4bc6-b18e-7caea544a93f => generated 1809 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 18:32:03.352356 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-d4ac16e9-5dfe-43c7-8033-a957324d85a4 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:32:03.354160 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-d4ac16e9-5dfe-43c7-8033-a957324d85a4 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] [instance: e10b3f49-1ff3-474c-833b-b83e3300e617] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:32:03.365675 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-d4ac16e9-5dfe-43c7-8033-a957324d85a4 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:03.366302 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-d4ac16e9-5dfe-43c7-8033-a957324d85a4 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:03.367971 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-d4ac16e9-5dfe-43c7-8033-a957324d85a4 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:03.368928 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-d4ac16e9-5dfe-43c7-8033-a957324d85a4 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:03.558483 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-d4ac16e9-5dfe-43c7-8033-a957324d85a4 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512f01cca14b447c8f6c9eebbd828eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70bbccf07e3404cb94ba59201061a6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:32:03.568770 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-d4ac16e9-5dfe-43c7-8033-a957324d85a4 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] 10.222.0.30 "GET /compute/v2.1/servers/e10b3f49-1ff3-474c-833b-b83e3300e617" status: 200 len: 1566 microversion: 2.1 time: 0.224589 Jun 16 18:32:03.569754 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 175/393] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:32:03 2022] GET /compute/v2.1/servers/e10b3f49-1ff3-474c-833b-b83e3300e617 => generated 1566 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:32:03.592845 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-7781bcb4-bf9e-436d-b004-dbbd4ef10e6b tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:32:03.593696 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-7781bcb4-bf9e-436d-b004-dbbd4ef10e6b tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] [instance: e10b3f49-1ff3-474c-833b-b83e3300e617] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:32:03.600454 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-7781bcb4-bf9e-436d-b004-dbbd4ef10e6b tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:03.600921 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-7781bcb4-bf9e-436d-b004-dbbd4ef10e6b tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:03.602612 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-7781bcb4-bf9e-436d-b004-dbbd4ef10e6b tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:03.603055 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-7781bcb4-bf9e-436d-b004-dbbd4ef10e6b tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:03.932680 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-7781bcb4-bf9e-436d-b004-dbbd4ef10e6b tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] 10.222.0.30 "GET /compute/v2.1/servers/e10b3f49-1ff3-474c-833b-b83e3300e617/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.343763 Jun 16 18:32:03.933327 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 219/394] 10.222.0.30 () {58 vars in 1274 bytes} [Thu Jun 16 18:32:03 2022] GET /compute/v2.1/servers/e10b3f49-1ff3-474c-833b-b83e3300e617/os-interface => generated 285 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:32:04.009178 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-57e9def5-1708-431d-9eae-f847595d98b9 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:32:04.010041 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-57e9def5-1708-431d-9eae-f847595d98b9 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] [instance: 651b5fe1-0df7-4bc6-b18e-7caea544a93f] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:32:04.017398 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-57e9def5-1708-431d-9eae-f847595d98b9 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:04.017846 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-57e9def5-1708-431d-9eae-f847595d98b9 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:04.018638 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-57e9def5-1708-431d-9eae-f847595d98b9 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:04.019065 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-57e9def5-1708-431d-9eae-f847595d98b9 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:04.180621 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-57e9def5-1708-431d-9eae-f847595d98b9 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:32:04.190122 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-57e9def5-1708-431d-9eae-f847595d98b9 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:32:04.191642 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-57e9def5-1708-431d-9eae-f847595d98b9 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:32:04.192862 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-57e9def5-1708-431d-9eae-f847595d98b9 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] 10.222.0.30 "GET /compute/v2.1/servers/651b5fe1-0df7-4bc6-b18e-7caea544a93f" status: 200 len: 1809 microversion: 2.20 time: 0.188240 Jun 16 18:32:04.193422 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 176/395] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Jun 16 18:32:04 2022] GET /compute/v2.1/servers/651b5fe1-0df7-4bc6-b18e-7caea544a93f => generated 1809 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:32:05.135140 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [req-91300fda-88f4-4200-857e-fd1331cc4499 req-39121105-ac90-4585-87f6-21cc15a051c0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e10b3f49-1ff3-474c-833b-b83e3300e617", "tag": "415b1820-aec4-49ee-8ec3-7e34692c9dc5"}]} {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:32:05.140829 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG dbcounter [-] [117670] Writing DB stats nova_api:SELECT=92 {{(pid=117670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:32:05.149490 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [req-91300fda-88f4-4200-857e-fd1331cc4499 req-39121105-ac90-4585-87f6-21cc15a051c0 service nova] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:05.150032 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [req-91300fda-88f4-4200-857e-fd1331cc4499 req-39121105-ac90-4585-87f6-21cc15a051c0 service nova] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:05.162846 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.compute.server_external_events [req-91300fda-88f4-4200-857e-fd1331cc4499 req-39121105-ac90-4585-87f6-21cc15a051c0 service nova] Creating event network-changed:415b1820-aec4-49ee-8ec3-7e34692c9dc5 for instance e10b3f49-1ff3-474c-833b-b83e3300e617 on hv-cinder-81322 Jun 16 18:32:05.170288 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [req-91300fda-88f4-4200-857e-fd1331cc4499 req-39121105-ac90-4585-87f6-21cc15a051c0 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040672 Jun 16 18:32:05.174420 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 220/396] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Jun 16 18:32:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 18:32:05.213707 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-886c4c6c-2921-4e78-ad94-f6a75a4f3a22 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:32:05.214679 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-886c4c6c-2921-4e78-ad94-f6a75a4f3a22 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] [instance: 651b5fe1-0df7-4bc6-b18e-7caea544a93f] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:32:05.233421 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-886c4c6c-2921-4e78-ad94-f6a75a4f3a22 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:05.234069 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-886c4c6c-2921-4e78-ad94-f6a75a4f3a22 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:05.235156 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-886c4c6c-2921-4e78-ad94-f6a75a4f3a22 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:05.235750 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-886c4c6c-2921-4e78-ad94-f6a75a4f3a22 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:05.490024 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-886c4c6c-2921-4e78-ad94-f6a75a4f3a22 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:32:05.509199 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-886c4c6c-2921-4e78-ad94-f6a75a4f3a22 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:32:05.513011 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-886c4c6c-2921-4e78-ad94-f6a75a4f3a22 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:32:05.515348 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-886c4c6c-2921-4e78-ad94-f6a75a4f3a22 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] 10.222.0.30 "GET /compute/v2.1/servers/651b5fe1-0df7-4bc6-b18e-7caea544a93f" status: 200 len: 1809 microversion: 2.20 time: 0.306674 Jun 16 18:32:05.527772 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 177/397] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Jun 16 18:32:05 2022] GET /compute/v2.1/servers/651b5fe1-0df7-4bc6-b18e-7caea544a93f => generated 1809 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 18:32:05.601129 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 16 18:32:05.601541 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: Thu Jun 16 18:32:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 16 18:32:06.546304 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-3f8339bd-a7bf-43f2-a022-322a18b0fc6a tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:32:06.547877 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-3f8339bd-a7bf-43f2-a022-322a18b0fc6a tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] [instance: 651b5fe1-0df7-4bc6-b18e-7caea544a93f] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:32:06.555752 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-3f8339bd-a7bf-43f2-a022-322a18b0fc6a tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:06.556591 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-3f8339bd-a7bf-43f2-a022-322a18b0fc6a tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:06.557642 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-3f8339bd-a7bf-43f2-a022-322a18b0fc6a tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:06.558314 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-3f8339bd-a7bf-43f2-a022-322a18b0fc6a tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:06.749255 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-3f8339bd-a7bf-43f2-a022-322a18b0fc6a tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:32:06.760963 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-3f8339bd-a7bf-43f2-a022-322a18b0fc6a tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:32:06.763033 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-3f8339bd-a7bf-43f2-a022-322a18b0fc6a tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:32:06.764455 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-3f8339bd-a7bf-43f2-a022-322a18b0fc6a tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] 10.222.0.30 "GET /compute/v2.1/servers/651b5fe1-0df7-4bc6-b18e-7caea544a93f" status: 200 len: 1809 microversion: 2.20 time: 0.223370 Jun 16 18:32:06.765173 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 221/398] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Jun 16 18:32:06 2022] GET /compute/v2.1/servers/651b5fe1-0df7-4bc6-b18e-7caea544a93f => generated 1809 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 18:32:07.794006 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-7fd8feba-a054-4a7b-a592-2f00fe185ea2 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:32:07.795353 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-7fd8feba-a054-4a7b-a592-2f00fe185ea2 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] [instance: 651b5fe1-0df7-4bc6-b18e-7caea544a93f] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:32:07.807023 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-7fd8feba-a054-4a7b-a592-2f00fe185ea2 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:07.807439 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-7fd8feba-a054-4a7b-a592-2f00fe185ea2 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:07.808571 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-7fd8feba-a054-4a7b-a592-2f00fe185ea2 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:07.809440 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-7fd8feba-a054-4a7b-a592-2f00fe185ea2 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:08.004844 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-7fd8feba-a054-4a7b-a592-2f00fe185ea2 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:32:08.016430 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-7fd8feba-a054-4a7b-a592-2f00fe185ea2 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:32:08.017955 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-7fd8feba-a054-4a7b-a592-2f00fe185ea2 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:32:08.019250 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-7fd8feba-a054-4a7b-a592-2f00fe185ea2 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] 10.222.0.30 "GET /compute/v2.1/servers/651b5fe1-0df7-4bc6-b18e-7caea544a93f" status: 200 len: 1809 microversion: 2.20 time: 0.230230 Jun 16 18:32:08.019789 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 178/399] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Jun 16 18:32:07 2022] GET /compute/v2.1/servers/651b5fe1-0df7-4bc6-b18e-7caea544a93f => generated 1809 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:32:08.035084 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-d6776cd5-5a59-40ee-9497-94a7e332af01 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:32:08.036399 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-d6776cd5-5a59-40ee-9497-94a7e332af01 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] [instance: e1382e00-fe71-4915-b4d8-0669cce4072d] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:32:08.045645 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-d6776cd5-5a59-40ee-9497-94a7e332af01 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:08.046080 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-d6776cd5-5a59-40ee-9497-94a7e332af01 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:08.047247 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-d6776cd5-5a59-40ee-9497-94a7e332af01 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:08.047693 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-d6776cd5-5a59-40ee-9497-94a7e332af01 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:08.079340 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-d6776cd5-5a59-40ee-9497-94a7e332af01 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] 10.222.0.30 "GET /compute/v2.1/servers/e1382e00-fe71-4915-b4d8-0669cce4072d/ips" status: 200 len: 148 microversion: 2.1 time: 0.048913 Jun 16 18:32:08.079909 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 222/400] 10.222.0.30 () {58 vars in 1247 bytes} [Thu Jun 16 18:32:08 2022] GET /compute/v2.1/servers/e1382e00-fe71-4915-b4d8-0669cce4072d/ips => generated 148 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 18:32:08.099021 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-4efbded1-7099-450e-9263-1a87909fd2f4 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "07b1d436-a3e6-4fa5-905b-3e36b8061271"}} {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:32:08.101122 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-4efbded1-7099-450e-9263-1a87909fd2f4 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] [instance: e1382e00-fe71-4915-b4d8-0669cce4072d] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:32:08.112895 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-4efbded1-7099-450e-9263-1a87909fd2f4 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:08.113704 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-4efbded1-7099-450e-9263-1a87909fd2f4 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:08.115118 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-4efbded1-7099-450e-9263-1a87909fd2f4 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:08.115893 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-4efbded1-7099-450e-9263-1a87909fd2f4 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:08.235410 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.wsgi [None req-4efbded1-7099-450e-9263-1a87909fd2f4 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] HTTP exception thrown: Invalid volume: volume 07b1d436-a3e6-4fa5-905b-3e36b8061271 is already attached to instances: 121f052a-2d96-444d-a817-38e348aaf0e5 Jun 16 18:32:08.237215 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-4efbded1-7099-450e-9263-1a87909fd2f4 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Request method failure captured: Jun 16 18:32:08.237215 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: request: POST /compute/v2.1/servers/e1382e00-fe71-4915-b4d8-0669cce4072d/os-volume_attachments HTTP/1.1 Jun 16 18:32:08.237215 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: Accept: application/json Jun 16 18:32:08.237215 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: Accept-Encoding: identity Jun 16 18:32:08.237215 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: Connection: close Jun 16 18:32:08.237215 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: Content-Length: 74 Jun 16 18:32:08.237215 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: Content-Type: application/json Jun 16 18:32:08.237215 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: Host: 10.222.0.30 Jun 16 18:32:08.237215 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: Openstack-System-Scope: None Jun 16 18:32:08.237215 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: User-Agent: python-urllib3/1.26.9 Jun 16 18:32:08.237215 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Auth-Token: gAAAAABiq3ZX0T5cncUq62ubfwO6lq1Lv4hHDbhnjkkOIJCFH6tDdIm4lTs2-IIDJl9nzK-SwFmooLj6i7tKw5uiIiGwCsi7P_mYy-sE7ccdLwqhACdzBDGvbvHDziedNnH_4yw_ULKqsIs-KqEoe_8V5KONSdInylhgSWkEXyoNm7uUe3r64xc Jun 16 18:32:08.237215 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Domain-Id: None Jun 16 18:32:08.237215 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Domain-Name: None Jun 16 18:32:08.237215 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Identity-Status: Confirmed Jun 16 18:32:08.237215 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Is-Admin-Project: True Jun 16 18:32:08.237215 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Project-Domain-Id: default Jun 16 18:32:08.237215 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Project-Domain-Name: Default Jun 16 18:32:08.237215 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Project-Id: 1f0473c6214a4428be438fabc530012b Jun 16 18:32:08.237215 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Project-Name: tempest-AttachVolumeNegativeTest-1927047282 Jun 16 18:32:08.237215 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Role: reader,member Jun 16 18:32:08.237215 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Roles: reader,member Jun 16 18:32:08.239686 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/1f0473c6214a4428be438fabc530012b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/1f0473c6214a4428be438fabc530012b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_1f0473c6214a4428be438fabc530012b", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/1f0473c6214a4428be438fabc530012b"}]}] Jun 16 18:32:08.239686 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Tenant: tempest-AttachVolumeNegativeTest-1927047282 Jun 16 18:32:08.239686 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Tenant-Id: 1f0473c6214a4428be438fabc530012b Jun 16 18:32:08.239686 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1927047282 Jun 16 18:32:08.239686 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-User: tempest-AttachVolumeNegativeTest-1927047282-project Jun 16 18:32:08.239686 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-User-Domain-Id: default Jun 16 18:32:08.239686 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-User-Domain-Name: Default Jun 16 18:32:08.239686 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-User-Id: 89f6c755dbf74640a372802f02733eb3 Jun 16 18:32:08.239686 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-User-Name: tempest-AttachVolumeNegativeTest-1927047282-project Jun 16 18:32:08.239686 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: Jun 16 18:32:08.239686 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: {"volumeAttachment": {"volumeId": "07b1d436-a3e6-4fa5-905b-3e36b8061271"}} Jun 16 18:32:08.239686 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: method: > Jun 16 18:32:08.241240 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: exception: Invalid volume: volume 07b1d436-a3e6-4fa5-905b-3e36b8061271 is already attached to instances: 121f052a-2d96-444d-a817-38e348aaf0e5 Jun 16 18:32:08.241240 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: action_args: {'server_id': 'e1382e00-fe71-4915-b4d8-0669cce4072d', 'body': {'volumeAttachment': {'volumeId': '07b1d436-a3e6-4fa5-905b-3e36b8061271'}}} Jun 16 18:32:08.241240 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:32:08.241240 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:32:08.241240 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 16 18:32:08.241240 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 16 18:32:08.241240 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 16 18:32:08.241240 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 16 18:32:08.241240 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 16 18:32:08.241240 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 16 18:32:08.241240 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jun 16 18:32:08.241240 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jun 16 18:32:08.241240 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jun 16 18:32:08.241240 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jun 16 18:32:08.241240 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 07b1d436-a3e6-4fa5-905b-3e36b8061271 is already attached to instances: 121f052a-2d96-444d-a817-38e348aaf0e5 Jun 16 18:32:08.241240 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Jun 16 18:32:08.241240 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:32:08.241240 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Jun 16 18:32:08.241240 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:32:08.243788 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:32:08.243788 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:32:08.243788 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:32:08.243788 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:32:08.243788 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:32:08.243788 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:32:08.243788 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 18:32:08.243788 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 18:32:08.243788 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 18:32:08.243788 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 18:32:08.243788 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 18:32:08.243788 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 18:32:08.243788 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jun 16 18:32:08.243788 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 16 18:32:08.243788 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 07b1d436-a3e6-4fa5-905b-3e36b8061271 is already attached to instances: 121f052a-2d96-444d-a817-38e348aaf0e5 Jun 16 18:32:08.243788 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Jun 16 18:32:08.243788 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:32:08.243788 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Jun 16 18:32:08.243788 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:32:08.243788 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:32:08.246172 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:32:08.246172 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:32:08.246172 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:32:08.246172 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 07b1d436-a3e6-4fa5-905b-3e36b8061271 is already attached to instances: 121f052a-2d96-444d-a817-38e348aaf0e5 Jun 16 18:32:08.246172 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Jun 16 18:32:08.246172 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-4efbded1-7099-450e-9263-1a87909fd2f4 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Returning 400 to user: Invalid volume: volume 07b1d436-a3e6-4fa5-905b-3e36b8061271 is already attached to instances: 121f052a-2d96-444d-a817-38e348aaf0e5 {{(pid=117671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:32:08.246172 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-4efbded1-7099-450e-9263-1a87909fd2f4 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] 10.222.0.30 "POST /compute/v2.1/servers/e1382e00-fe71-4915-b4d8-0669cce4072d/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.147435 Jun 16 18:32:08.246172 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 179/401] 10.222.0.30 () {60 vars in 1322 bytes} [Thu Jun 16 18:32:08 2022] POST /compute/v2.1/servers/e1382e00-fe71-4915-b4d8-0669cce4072d/os-volume_attachments => generated 174 bytes in 149 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 16 18:32:08.255156 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-9a0e682e-c240-4b13-9006-d0940887134b tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:32:08.256165 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-9a0e682e-c240-4b13-9006-d0940887134b tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] [instance: e1382e00-fe71-4915-b4d8-0669cce4072d] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:32:08.268150 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-9a0e682e-c240-4b13-9006-d0940887134b tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:08.269402 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-9a0e682e-c240-4b13-9006-d0940887134b tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:08.270857 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-9a0e682e-c240-4b13-9006-d0940887134b tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:08.271456 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-9a0e682e-c240-4b13-9006-d0940887134b tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:08.306663 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-9a0e682e-c240-4b13-9006-d0940887134b tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] [instance: e1382e00-fe71-4915-b4d8-0669cce4072d] Going to try to terminate instance {{(pid=117670) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 18:32:08.429691 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-9a0e682e-c240-4b13-9006-d0940887134b tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] 10.222.0.30 "DELETE /compute/v2.1/servers/e1382e00-fe71-4915-b4d8-0669cce4072d" status: 204 len: 0 microversion: 2.1 time: 0.183175 Jun 16 18:32:08.430431 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 223/402] 10.222.0.30 () {58 vars in 1238 bytes} [Thu Jun 16 18:32:08 2022] DELETE /compute/v2.1/servers/e1382e00-fe71-4915-b4d8-0669cce4072d => generated 0 bytes in 186 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 18:32:08.442009 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-3a1b831f-c46f-43d3-b903-3b1fc8a0bc01 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:32:08.442712 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-3a1b831f-c46f-43d3-b903-3b1fc8a0bc01 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] [instance: e1382e00-fe71-4915-b4d8-0669cce4072d] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:32:08.450473 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-3a1b831f-c46f-43d3-b903-3b1fc8a0bc01 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:08.451575 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-3a1b831f-c46f-43d3-b903-3b1fc8a0bc01 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:08.452408 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-3a1b831f-c46f-43d3-b903-3b1fc8a0bc01 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:08.452845 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-3a1b831f-c46f-43d3-b903-3b1fc8a0bc01 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:08.625712 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-3a1b831f-c46f-43d3-b903-3b1fc8a0bc01 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f6c755dbf74640a372802f02733eb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f0473c6214a4428be438fabc530012b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:32:08.634663 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-3a1b831f-c46f-43d3-b903-3b1fc8a0bc01 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] 10.222.0.30 "GET /compute/v2.1/servers/e1382e00-fe71-4915-b4d8-0669cce4072d" status: 200 len: 1681 microversion: 2.1 time: 0.198137 Jun 16 18:32:08.635243 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 180/403] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:32:08 2022] GET /compute/v2.1/servers/e1382e00-fe71-4915-b4d8-0669cce4072d => generated 1681 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:32:09.043359 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-ad603c08-af6e-40f1-ab3a-31af78c23900 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:32:09.045210 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-ad603c08-af6e-40f1-ab3a-31af78c23900 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] [instance: 651b5fe1-0df7-4bc6-b18e-7caea544a93f] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:32:09.053949 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-ad603c08-af6e-40f1-ab3a-31af78c23900 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:09.054691 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-ad603c08-af6e-40f1-ab3a-31af78c23900 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:09.055683 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-ad603c08-af6e-40f1-ab3a-31af78c23900 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:09.056460 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-ad603c08-af6e-40f1-ab3a-31af78c23900 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:09.248741 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-ad603c08-af6e-40f1-ab3a-31af78c23900 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:32:09.265103 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-ad603c08-af6e-40f1-ab3a-31af78c23900 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:32:09.268101 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-ad603c08-af6e-40f1-ab3a-31af78c23900 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:32:09.269975 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-ad603c08-af6e-40f1-ab3a-31af78c23900 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] 10.222.0.30 "GET /compute/v2.1/servers/651b5fe1-0df7-4bc6-b18e-7caea544a93f" status: 200 len: 1809 microversion: 2.20 time: 0.232478 Jun 16 18:32:09.270838 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 224/404] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Jun 16 18:32:09 2022] GET /compute/v2.1/servers/651b5fe1-0df7-4bc6-b18e-7caea544a93f => generated 1809 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 18:32:09.655426 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-b117377f-6665-416f-b3fb-d8250103d06e tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:32:09.656721 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-b117377f-6665-416f-b3fb-d8250103d06e tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] [instance: e1382e00-fe71-4915-b4d8-0669cce4072d] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:32:09.664988 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-b117377f-6665-416f-b3fb-d8250103d06e tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:09.665504 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-b117377f-6665-416f-b3fb-d8250103d06e tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:09.666639 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-b117377f-6665-416f-b3fb-d8250103d06e tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:09.667087 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-b117377f-6665-416f-b3fb-d8250103d06e tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:09.861174 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-b117377f-6665-416f-b3fb-d8250103d06e tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f6c755dbf74640a372802f02733eb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f0473c6214a4428be438fabc530012b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:32:09.876816 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-b117377f-6665-416f-b3fb-d8250103d06e tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] 10.222.0.30 "GET /compute/v2.1/servers/e1382e00-fe71-4915-b4d8-0669cce4072d" status: 200 len: 1681 microversion: 2.1 time: 0.225708 Jun 16 18:32:09.877851 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 181/405] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:32:09 2022] GET /compute/v2.1/servers/e1382e00-fe71-4915-b4d8-0669cce4072d => generated 1681 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:32:10.292136 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-706dc367-bb94-49ec-a426-d705afd4ce5f tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:32:10.292764 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-706dc367-bb94-49ec-a426-d705afd4ce5f tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] [instance: 651b5fe1-0df7-4bc6-b18e-7caea544a93f] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:32:10.300715 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-706dc367-bb94-49ec-a426-d705afd4ce5f tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:10.301254 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-706dc367-bb94-49ec-a426-d705afd4ce5f tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:10.301943 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-706dc367-bb94-49ec-a426-d705afd4ce5f tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:10.302389 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-706dc367-bb94-49ec-a426-d705afd4ce5f tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:10.474770 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-706dc367-bb94-49ec-a426-d705afd4ce5f tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:32:10.485464 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-706dc367-bb94-49ec-a426-d705afd4ce5f tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:32:10.487052 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-706dc367-bb94-49ec-a426-d705afd4ce5f tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:32:10.488695 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-706dc367-bb94-49ec-a426-d705afd4ce5f tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] 10.222.0.30 "GET /compute/v2.1/servers/651b5fe1-0df7-4bc6-b18e-7caea544a93f" status: 200 len: 1809 microversion: 2.20 time: 0.201362 Jun 16 18:32:10.489644 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 225/406] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Jun 16 18:32:10 2022] GET /compute/v2.1/servers/651b5fe1-0df7-4bc6-b18e-7caea544a93f => generated 1809 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:32:10.897172 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-a64ca254-5f41-4a36-83f4-b1c4e1b9cc40 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:32:10.898652 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-a64ca254-5f41-4a36-83f4-b1c4e1b9cc40 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] [instance: e1382e00-fe71-4915-b4d8-0669cce4072d] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:32:10.906024 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-a64ca254-5f41-4a36-83f4-b1c4e1b9cc40 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:10.906877 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-a64ca254-5f41-4a36-83f4-b1c4e1b9cc40 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:10.907811 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-a64ca254-5f41-4a36-83f4-b1c4e1b9cc40 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:10.908368 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-a64ca254-5f41-4a36-83f4-b1c4e1b9cc40 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:11.077551 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-a64ca254-5f41-4a36-83f4-b1c4e1b9cc40 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f6c755dbf74640a372802f02733eb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f0473c6214a4428be438fabc530012b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:32:11.088834 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-a64ca254-5f41-4a36-83f4-b1c4e1b9cc40 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] 10.222.0.30 "GET /compute/v2.1/servers/e1382e00-fe71-4915-b4d8-0669cce4072d" status: 200 len: 1681 microversion: 2.1 time: 0.197625 Jun 16 18:32:11.089434 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 182/407] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:32:10 2022] GET /compute/v2.1/servers/e1382e00-fe71-4915-b4d8-0669cce4072d => generated 1681 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:32:11.520736 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-3daf659a-9bf5-4ecc-b768-5977dd75ec21 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:32:11.523941 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-3daf659a-9bf5-4ecc-b768-5977dd75ec21 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] [instance: 651b5fe1-0df7-4bc6-b18e-7caea544a93f] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:32:11.536491 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-3daf659a-9bf5-4ecc-b768-5977dd75ec21 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:11.541670 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-3daf659a-9bf5-4ecc-b768-5977dd75ec21 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:11.541670 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-3daf659a-9bf5-4ecc-b768-5977dd75ec21 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:11.541670 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-3daf659a-9bf5-4ecc-b768-5977dd75ec21 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:11.886505 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-3daf659a-9bf5-4ecc-b768-5977dd75ec21 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:32:11.901219 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-3daf659a-9bf5-4ecc-b768-5977dd75ec21 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:32:11.904919 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-3daf659a-9bf5-4ecc-b768-5977dd75ec21 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:32:11.906859 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-3daf659a-9bf5-4ecc-b768-5977dd75ec21 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] 10.222.0.30 "GET /compute/v2.1/servers/651b5fe1-0df7-4bc6-b18e-7caea544a93f" status: 200 len: 1809 microversion: 2.20 time: 0.393700 Jun 16 18:32:11.908103 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 226/408] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Jun 16 18:32:11 2022] GET /compute/v2.1/servers/651b5fe1-0df7-4bc6-b18e-7caea544a93f => generated 1809 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:32:11.912576 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-ac0fdc99-b5ec-4767-acba-877323f1e286 tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:32:11.915710 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-ac0fdc99-b5ec-4767-acba-877323f1e286 tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] [instance: 26fdb428-7e41-4e0f-b91a-15009844089f] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:32:11.924815 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-ac0fdc99-b5ec-4767-acba-877323f1e286 tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:11.925773 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-ac0fdc99-b5ec-4767-acba-877323f1e286 tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:11.933277 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-ac0fdc99-b5ec-4767-acba-877323f1e286 tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:11.934143 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-ac0fdc99-b5ec-4767-acba-877323f1e286 tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:12.112507 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-08638600-a043-47c5-a258-9bc55dad2e85 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:32:12.115031 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-08638600-a043-47c5-a258-9bc55dad2e85 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] [instance: e1382e00-fe71-4915-b4d8-0669cce4072d] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:32:12.129211 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-08638600-a043-47c5-a258-9bc55dad2e85 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:12.131143 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-08638600-a043-47c5-a258-9bc55dad2e85 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:12.133852 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-08638600-a043-47c5-a258-9bc55dad2e85 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:12.135262 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-08638600-a043-47c5-a258-9bc55dad2e85 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:12.180640 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-ac0fdc99-b5ec-4767-acba-877323f1e286 tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7d57c4231b49b28a606a17e42267e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9fa2caa1412451aa0308c807d5c62d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:32:12.216477 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-ac0fdc99-b5ec-4767-acba-877323f1e286 tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] 10.222.0.30 "GET /compute/v2.1/servers/26fdb428-7e41-4e0f-b91a-15009844089f" status: 200 len: 1595 microversion: 2.1 time: 0.315443 Jun 16 18:32:12.217996 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 183/409] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:32:11 2022] GET /compute/v2.1/servers/26fdb428-7e41-4e0f-b91a-15009844089f => generated 1595 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:32:12.446796 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [req-2520dfe9-4f08-4d61-9402-437e2e28edcc req-e2f29b58-10e8-41e4-ae73-e5bc1522dd81 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "651b5fe1-0df7-4bc6-b18e-7caea544a93f", "name": "network-vif-plugged", "status": "completed", "tag": "7416c7c3-1e79-4777-a950-c0c27847ca8e"}]} {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:32:12.465383 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [req-2520dfe9-4f08-4d61-9402-437e2e28edcc req-e2f29b58-10e8-41e4-ae73-e5bc1522dd81 service nova] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:12.466528 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [req-2520dfe9-4f08-4d61-9402-437e2e28edcc req-e2f29b58-10e8-41e4-ae73-e5bc1522dd81 service nova] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:12.490384 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.compute.server_external_events [req-2520dfe9-4f08-4d61-9402-437e2e28edcc req-e2f29b58-10e8-41e4-ae73-e5bc1522dd81 service nova] Creating event network-vif-plugged:7416c7c3-1e79-4777-a950-c0c27847ca8e for instance 651b5fe1-0df7-4bc6-b18e-7caea544a93f on hv-cinder-81322 Jun 16 18:32:12.501481 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [req-2520dfe9-4f08-4d61-9402-437e2e28edcc req-e2f29b58-10e8-41e4-ae73-e5bc1522dd81 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061484 Jun 16 18:32:12.503023 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 184/410] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Jun 16 18:32:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:32:12.773194 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-08638600-a043-47c5-a258-9bc55dad2e85 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f6c755dbf74640a372802f02733eb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f0473c6214a4428be438fabc530012b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:32:12.799287 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-08638600-a043-47c5-a258-9bc55dad2e85 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] 10.222.0.30 "GET /compute/v2.1/servers/e1382e00-fe71-4915-b4d8-0669cce4072d" status: 200 len: 1681 microversion: 2.1 time: 0.694286 Jun 16 18:32:12.800260 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 227/411] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:32:12 2022] GET /compute/v2.1/servers/e1382e00-fe71-4915-b4d8-0669cce4072d => generated 1681 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:32:12.938598 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-be888e91-b186-4423-b65a-4dccec6d9b90 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:32:12.939977 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-be888e91-b186-4423-b65a-4dccec6d9b90 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] [instance: 651b5fe1-0df7-4bc6-b18e-7caea544a93f] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:32:12.951647 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-be888e91-b186-4423-b65a-4dccec6d9b90 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:12.952680 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-be888e91-b186-4423-b65a-4dccec6d9b90 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:12.954513 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-be888e91-b186-4423-b65a-4dccec6d9b90 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:12.955254 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-be888e91-b186-4423-b65a-4dccec6d9b90 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:13.221991 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-be888e91-b186-4423-b65a-4dccec6d9b90 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:32:13.245182 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-be888e91-b186-4423-b65a-4dccec6d9b90 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:32:13.248909 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-be888e91-b186-4423-b65a-4dccec6d9b90 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:32:13.251665 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-be888e91-b186-4423-b65a-4dccec6d9b90 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] 10.222.0.30 "GET /compute/v2.1/servers/651b5fe1-0df7-4bc6-b18e-7caea544a93f" status: 200 len: 1809 microversion: 2.20 time: 0.319095 Jun 16 18:32:13.253103 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 185/412] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Jun 16 18:32:12 2022] GET /compute/v2.1/servers/651b5fe1-0df7-4bc6-b18e-7caea544a93f => generated 1809 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 18:32:13.825163 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-e283ff70-129b-421c-bcac-f59368335cc5 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:32:13.825903 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-e283ff70-129b-421c-bcac-f59368335cc5 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] [instance: e1382e00-fe71-4915-b4d8-0669cce4072d] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:32:13.836995 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-e283ff70-129b-421c-bcac-f59368335cc5 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:13.837433 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-e283ff70-129b-421c-bcac-f59368335cc5 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:13.838231 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-e283ff70-129b-421c-bcac-f59368335cc5 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:13.838736 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-e283ff70-129b-421c-bcac-f59368335cc5 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:14.026640 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-e283ff70-129b-421c-bcac-f59368335cc5 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f6c755dbf74640a372802f02733eb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f0473c6214a4428be438fabc530012b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:32:14.043168 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-e283ff70-129b-421c-bcac-f59368335cc5 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] 10.222.0.30 "GET /compute/v2.1/servers/e1382e00-fe71-4915-b4d8-0669cce4072d" status: 200 len: 1613 microversion: 2.1 time: 0.221720 Jun 16 18:32:14.045206 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 228/413] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:32:13 2022] GET /compute/v2.1/servers/e1382e00-fe71-4915-b4d8-0669cce4072d => generated 1613 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:32:14.078612 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [req-45aa0ac9-b9d2-4831-82f5-3421a0957afe req-907187af-4637-4949-8830-dcec0772a852 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1382e00-fe71-4915-b4d8-0669cce4072d", "name": "network-vif-deleted", "tag": "561647b3-5ae8-4d31-9f4a-ca1106d4478e"}]} {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:32:14.105974 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [req-45aa0ac9-b9d2-4831-82f5-3421a0957afe req-907187af-4637-4949-8830-dcec0772a852 service nova] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:14.106536 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [req-45aa0ac9-b9d2-4831-82f5-3421a0957afe req-907187af-4637-4949-8830-dcec0772a852 service nova] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:14.146739 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.compute.server_external_events [req-45aa0ac9-b9d2-4831-82f5-3421a0957afe req-907187af-4637-4949-8830-dcec0772a852 service nova] Creating event network-vif-deleted:561647b3-5ae8-4d31-9f4a-ca1106d4478e for instance e1382e00-fe71-4915-b4d8-0669cce4072d on hv-cinder-81322 Jun 16 18:32:14.155162 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [req-45aa0ac9-b9d2-4831-82f5-3421a0957afe req-907187af-4637-4949-8830-dcec0772a852 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084046 Jun 16 18:32:14.156597 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 186/414] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Jun 16 18:32:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:32:14.281875 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-eb3e0632-49a1-4ef2-ab32-f132119d996d tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:32:14.283112 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-eb3e0632-49a1-4ef2-ab32-f132119d996d tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] [instance: 651b5fe1-0df7-4bc6-b18e-7caea544a93f] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:32:14.303643 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-eb3e0632-49a1-4ef2-ab32-f132119d996d tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:14.304955 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-eb3e0632-49a1-4ef2-ab32-f132119d996d tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:14.306334 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-eb3e0632-49a1-4ef2-ab32-f132119d996d tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:14.307007 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-eb3e0632-49a1-4ef2-ab32-f132119d996d tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:14.534559 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [req-4e85bfbb-24b6-44d7-9ebb-fbcacef1d5e6 req-11ea3b9e-6ccb-4a47-a842-5ecfc4236f45 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1382e00-fe71-4915-b4d8-0669cce4072d", "name": "network-vif-unplugged", "status": "completed", "tag": "561647b3-5ae8-4d31-9f4a-ca1106d4478e"}]} {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:32:14.548290 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [req-4e85bfbb-24b6-44d7-9ebb-fbcacef1d5e6 req-11ea3b9e-6ccb-4a47-a842-5ecfc4236f45 service nova] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:14.549474 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [req-4e85bfbb-24b6-44d7-9ebb-fbcacef1d5e6 req-11ea3b9e-6ccb-4a47-a842-5ecfc4236f45 service nova] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:14.567470 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-eb3e0632-49a1-4ef2-ab32-f132119d996d tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:32:14.568425 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.compute.server_external_events [req-4e85bfbb-24b6-44d7-9ebb-fbcacef1d5e6 req-11ea3b9e-6ccb-4a47-a842-5ecfc4236f45 service nova] Creating event network-vif-unplugged:561647b3-5ae8-4d31-9f4a-ca1106d4478e for instance e1382e00-fe71-4915-b4d8-0669cce4072d on hv-cinder-81322 Jun 16 18:32:14.581565 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [req-4e85bfbb-24b6-44d7-9ebb-fbcacef1d5e6 req-11ea3b9e-6ccb-4a47-a842-5ecfc4236f45 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.052497 Jun 16 18:32:14.582627 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 187/415] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Jun 16 18:32:14 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:32:14.585227 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-eb3e0632-49a1-4ef2-ab32-f132119d996d tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:32:14.588184 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-eb3e0632-49a1-4ef2-ab32-f132119d996d tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:32:14.589822 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-eb3e0632-49a1-4ef2-ab32-f132119d996d tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] 10.222.0.30 "GET /compute/v2.1/servers/651b5fe1-0df7-4bc6-b18e-7caea544a93f" status: 200 len: 1809 microversion: 2.20 time: 0.313419 Jun 16 18:32:14.600945 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 229/416] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Jun 16 18:32:14 2022] GET /compute/v2.1/servers/651b5fe1-0df7-4bc6-b18e-7caea544a93f => generated 1809 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:32:15.067244 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-627de79f-39ae-42ac-9923-18ea217178e0 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:32:15.068731 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-627de79f-39ae-42ac-9923-18ea217178e0 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] [instance: e1382e00-fe71-4915-b4d8-0669cce4072d] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:32:15.096311 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-627de79f-39ae-42ac-9923-18ea217178e0 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:15.098952 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-627de79f-39ae-42ac-9923-18ea217178e0 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:15.101717 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-627de79f-39ae-42ac-9923-18ea217178e0 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:15.103786 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-627de79f-39ae-42ac-9923-18ea217178e0 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:15.157305 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-627de79f-39ae-42ac-9923-18ea217178e0 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:15.158035 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-627de79f-39ae-42ac-9923-18ea217178e0 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:15.158506 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.objects.instance [None req-627de79f-39ae-42ac-9923-18ea217178e0 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lazy-loading 'fault' on Instance uuid e1382e00-fe71-4915-b4d8-0669cce4072d {{(pid=117671) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 18:32:15.227303 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-627de79f-39ae-42ac-9923-18ea217178e0 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f6c755dbf74640a372802f02733eb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f0473c6214a4428be438fabc530012b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:32:15.235998 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-627de79f-39ae-42ac-9923-18ea217178e0 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] 10.222.0.30 "GET /compute/v2.1/servers/e1382e00-fe71-4915-b4d8-0669cce4072d" status: 200 len: 1332 microversion: 2.1 time: 0.176715 Jun 16 18:32:15.248744 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 188/417] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:32:15 2022] GET /compute/v2.1/servers/e1382e00-fe71-4915-b4d8-0669cce4072d => generated 1332 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:32:15.618523 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-d52fc3d6-93ae-4563-9af5-4af06356ffc0 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:32:15.621155 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-d52fc3d6-93ae-4563-9af5-4af06356ffc0 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] [instance: 651b5fe1-0df7-4bc6-b18e-7caea544a93f] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:32:15.670032 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-d52fc3d6-93ae-4563-9af5-4af06356ffc0 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:15.673284 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-d52fc3d6-93ae-4563-9af5-4af06356ffc0 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:15.677346 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-d52fc3d6-93ae-4563-9af5-4af06356ffc0 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:15.678198 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-d52fc3d6-93ae-4563-9af5-4af06356ffc0 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:16.168002 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-d52fc3d6-93ae-4563-9af5-4af06356ffc0 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:32:16.178988 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-d52fc3d6-93ae-4563-9af5-4af06356ffc0 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:32:16.181881 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-d52fc3d6-93ae-4563-9af5-4af06356ffc0 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:32:16.183644 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-d52fc3d6-93ae-4563-9af5-4af06356ffc0 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] 10.222.0.30 "GET /compute/v2.1/servers/651b5fe1-0df7-4bc6-b18e-7caea544a93f" status: 200 len: 1809 microversion: 2.20 time: 0.576291 Jun 16 18:32:16.185014 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 230/418] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Jun 16 18:32:15 2022] GET /compute/v2.1/servers/651b5fe1-0df7-4bc6-b18e-7caea544a93f => generated 1809 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:32:16.262129 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-cfb2c194-5607-4426-a0d7-b8f94c52695e tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:32:16.266115 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-cfb2c194-5607-4426-a0d7-b8f94c52695e tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] [instance: e1382e00-fe71-4915-b4d8-0669cce4072d] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:32:16.280497 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-cfb2c194-5607-4426-a0d7-b8f94c52695e tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:16.281323 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-cfb2c194-5607-4426-a0d7-b8f94c52695e tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:16.282404 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-cfb2c194-5607-4426-a0d7-b8f94c52695e tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:16.283110 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-cfb2c194-5607-4426-a0d7-b8f94c52695e tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:16.300818 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.wsgi [None req-cfb2c194-5607-4426-a0d7-b8f94c52695e tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] HTTP exception thrown: Instance e1382e00-fe71-4915-b4d8-0669cce4072d could not be found. Jun 16 18:32:16.303162 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-cfb2c194-5607-4426-a0d7-b8f94c52695e tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Request method failure captured: Jun 16 18:32:16.303162 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: request: GET /compute/v2.1/servers/e1382e00-fe71-4915-b4d8-0669cce4072d HTTP/1.1 Jun 16 18:32:16.303162 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: Accept: application/json Jun 16 18:32:16.303162 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: Accept-Encoding: identity Jun 16 18:32:16.303162 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: Connection: close Jun 16 18:32:16.303162 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: Content-Length: 0 Jun 16 18:32:16.303162 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: Content-Type: application/json Jun 16 18:32:16.303162 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: Host: 10.222.0.30 Jun 16 18:32:16.303162 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: Openstack-System-Scope: None Jun 16 18:32:16.303162 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: User-Agent: python-urllib3/1.26.9 Jun 16 18:32:16.303162 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Auth-Token: gAAAAABiq3ZX0T5cncUq62ubfwO6lq1Lv4hHDbhnjkkOIJCFH6tDdIm4lTs2-IIDJl9nzK-SwFmooLj6i7tKw5uiIiGwCsi7P_mYy-sE7ccdLwqhACdzBDGvbvHDziedNnH_4yw_ULKqsIs-KqEoe_8V5KONSdInylhgSWkEXyoNm7uUe3r64xc Jun 16 18:32:16.303162 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Domain-Id: None Jun 16 18:32:16.303162 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Domain-Name: None Jun 16 18:32:16.303162 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Identity-Status: Confirmed Jun 16 18:32:16.303162 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Is-Admin-Project: True Jun 16 18:32:16.303162 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Project-Domain-Id: default Jun 16 18:32:16.303162 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Project-Domain-Name: Default Jun 16 18:32:16.303162 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Project-Id: 1f0473c6214a4428be438fabc530012b Jun 16 18:32:16.303162 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Project-Name: tempest-AttachVolumeNegativeTest-1927047282 Jun 16 18:32:16.303162 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Role: reader,member Jun 16 18:32:16.303162 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Roles: reader,member Jun 16 18:32:16.305566 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/1f0473c6214a4428be438fabc530012b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/1f0473c6214a4428be438fabc530012b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_1f0473c6214a4428be438fabc530012b", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/1f0473c6214a4428be438fabc530012b"}]}] Jun 16 18:32:16.305566 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Tenant: tempest-AttachVolumeNegativeTest-1927047282 Jun 16 18:32:16.305566 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Tenant-Id: 1f0473c6214a4428be438fabc530012b Jun 16 18:32:16.305566 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1927047282 Jun 16 18:32:16.305566 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-User: tempest-AttachVolumeNegativeTest-1927047282-project Jun 16 18:32:16.305566 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-User-Domain-Id: default Jun 16 18:32:16.305566 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-User-Domain-Name: Default Jun 16 18:32:16.305566 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-User-Id: 89f6c755dbf74640a372802f02733eb3 Jun 16 18:32:16.305566 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-User-Name: tempest-AttachVolumeNegativeTest-1927047282-project Jun 16 18:32:16.305566 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: method: > Jun 16 18:32:16.305566 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: exception: Instance e1382e00-fe71-4915-b4d8-0669cce4072d could not be found. Jun 16 18:32:16.305566 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: action_args: {'id': 'e1382e00-fe71-4915-b4d8-0669cce4072d'} Jun 16 18:32:16.306535 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:32:16.306535 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:32:16.306535 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 18:32:16.306535 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 18:32:16.306535 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 18:32:16.306535 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 18:32:16.306535 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 18:32:16.306535 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 18:32:16.306535 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 18:32:16.306535 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 18:32:16.306535 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e1382e00-fe71-4915-b4d8-0669cce4072d could not be found. Jun 16 18:32:16.306535 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Jun 16 18:32:16.306535 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:32:16.306535 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Jun 16 18:32:16.306535 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:32:16.306535 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:32:16.306535 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:32:16.306535 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:32:16.306535 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:32:16.306535 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:32:16.309136 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:32:16.309136 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 18:32:16.309136 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 18:32:16.309136 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 18:32:16.309136 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 18:32:16.309136 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 18:32:16.309136 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:32:16.309136 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e1382e00-fe71-4915-b4d8-0669cce4072d could not be found. Jun 16 18:32:16.309136 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Jun 16 18:32:16.309136 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:32:16.309136 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Jun 16 18:32:16.309136 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:32:16.309136 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:32:16.309136 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:32:16.309136 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:32:16.309136 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:32:16.309136 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e1382e00-fe71-4915-b4d8-0669cce4072d could not be found. Jun 16 18:32:16.309136 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Jun 16 18:32:16.310416 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-cfb2c194-5607-4426-a0d7-b8f94c52695e tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Returning 404 to user: Instance e1382e00-fe71-4915-b4d8-0669cce4072d could not be found. {{(pid=117671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:32:16.310416 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-cfb2c194-5607-4426-a0d7-b8f94c52695e tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] 10.222.0.30 "GET /compute/v2.1/servers/e1382e00-fe71-4915-b4d8-0669cce4072d" status: 404 len: 111 microversion: 2.1 time: 0.054931 Jun 16 18:32:16.312670 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 189/419] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:32:16 2022] GET /compute/v2.1/servers/e1382e00-fe71-4915-b4d8-0669cce4072d => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:32:16.319095 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-ce83eb62-0e39-4ac7-bfba-3787be56fbe2 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Calling method '.version_select at 0x7fbb23e8eca0>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:32:16.349778 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-ce83eb62-0e39-4ac7-bfba-3787be56fbe2 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1549589118" status: 202 len: 0 microversion: 2.1 time: 0.035792 Jun 16 18:32:16.355286 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 231/420] 10.222.0.30 () {58 vars in 1220 bytes} [Thu Jun 16 18:32:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1549589118 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 18:32:16.964843 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [req-f3714dcd-2f8c-4962-97bb-1b11b69eb075 req-bba496aa-5e58-4649-9b28-4b98abedb465 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "26fdb428-7e41-4e0f-b91a-15009844089f", "tag": "60aa1d76-6fda-4493-91ab-da6bd2ca0a42"}]} {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:32:16.987454 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [req-f3714dcd-2f8c-4962-97bb-1b11b69eb075 req-bba496aa-5e58-4649-9b28-4b98abedb465 service nova] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:16.989944 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [req-f3714dcd-2f8c-4962-97bb-1b11b69eb075 req-bba496aa-5e58-4649-9b28-4b98abedb465 service nova] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:17.039963 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.compute.server_external_events [req-f3714dcd-2f8c-4962-97bb-1b11b69eb075 req-bba496aa-5e58-4649-9b28-4b98abedb465 service nova] Creating event network-changed:60aa1d76-6fda-4493-91ab-da6bd2ca0a42 for instance 26fdb428-7e41-4e0f-b91a-15009844089f on hv-cinder-81322 Jun 16 18:32:17.051570 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [req-f3714dcd-2f8c-4962-97bb-1b11b69eb075 req-bba496aa-5e58-4649-9b28-4b98abedb465 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098355 Jun 16 18:32:17.054831 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 190/421] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Jun 16 18:32:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:32:17.204037 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-a6a28838-dad4-47a9-9eae-0d28c6a907a6 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:32:17.205109 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-a6a28838-dad4-47a9-9eae-0d28c6a907a6 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] [instance: 651b5fe1-0df7-4bc6-b18e-7caea544a93f] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:32:17.213075 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-a6a28838-dad4-47a9-9eae-0d28c6a907a6 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:17.213536 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-a6a28838-dad4-47a9-9eae-0d28c6a907a6 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:17.214578 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-a6a28838-dad4-47a9-9eae-0d28c6a907a6 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:17.215205 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-a6a28838-dad4-47a9-9eae-0d28c6a907a6 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:18.026511 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-4bc1daec-a860-4647-9803-cfa279354868 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:32:18.028732 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-4bc1daec-a860-4647-9803-cfa279354868 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] [instance: 121f052a-2d96-444d-a817-38e348aaf0e5] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:32:18.043359 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-4bc1daec-a860-4647-9803-cfa279354868 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:18.044593 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-4bc1daec-a860-4647-9803-cfa279354868 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:18.046620 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-4bc1daec-a860-4647-9803-cfa279354868 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:18.047693 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-4bc1daec-a860-4647-9803-cfa279354868 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:18.067668 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-a6a28838-dad4-47a9-9eae-0d28c6a907a6 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:32:18.094230 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-a6a28838-dad4-47a9-9eae-0d28c6a907a6 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:32:18.101032 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-a6a28838-dad4-47a9-9eae-0d28c6a907a6 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:32:18.112606 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-a6a28838-dad4-47a9-9eae-0d28c6a907a6 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] 10.222.0.30 "GET /compute/v2.1/servers/651b5fe1-0df7-4bc6-b18e-7caea544a93f" status: 200 len: 1796 microversion: 2.20 time: 0.912910 Jun 16 18:32:18.113998 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 232/422] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Jun 16 18:32:17 2022] GET /compute/v2.1/servers/651b5fe1-0df7-4bc6-b18e-7caea544a93f => generated 1796 bytes in 916 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 18:32:18.345787 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.objects.instance [None req-4bc1daec-a860-4647-9803-cfa279354868 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lazy-loading 'services' on Instance uuid 121f052a-2d96-444d-a817-38e348aaf0e5 {{(pid=117671) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 18:32:18.579358 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-4bc1daec-a860-4647-9803-cfa279354868 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] 10.222.0.30 "DELETE /compute/v2.1/servers/121f052a-2d96-444d-a817-38e348aaf0e5/os-volume_attachments/07b1d436-a3e6-4fa5-905b-3e36b8061271" status: 202 len: 0 microversion: 2.1 time: 0.565286 Jun 16 18:32:18.580012 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 191/423] 10.222.0.30 () {58 vars in 1415 bytes} [Thu Jun 16 18:32:18 2022] DELETE /compute/v2.1/servers/121f052a-2d96-444d-a817-38e348aaf0e5/os-volume_attachments/07b1d436-a3e6-4fa5-905b-3e36b8061271 => generated 0 bytes in 569 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 18:32:18.593382 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-54812f5f-3029-4a07-926b-e7dc1b5ad51f tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:32:18.594435 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-54812f5f-3029-4a07-926b-e7dc1b5ad51f tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] [instance: 121f052a-2d96-444d-a817-38e348aaf0e5] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:32:18.608940 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-54812f5f-3029-4a07-926b-e7dc1b5ad51f tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:18.610048 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-54812f5f-3029-4a07-926b-e7dc1b5ad51f tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:18.613163 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-54812f5f-3029-4a07-926b-e7dc1b5ad51f tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:18.614033 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-54812f5f-3029-4a07-926b-e7dc1b5ad51f tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:18.730197 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-54812f5f-3029-4a07-926b-e7dc1b5ad51f tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] 10.222.0.30 "GET /compute/v2.1/servers/121f052a-2d96-444d-a817-38e348aaf0e5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.140536 Jun 16 18:32:18.736798 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 233/424] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Jun 16 18:32:18 2022] GET /compute/v2.1/servers/121f052a-2d96-444d-a817-38e348aaf0e5/os-volume_attachments => generated 197 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:32:19.246595 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-deab6e6d-4697-45ad-9020-f62a96b06914 tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-860295531"}} {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:32:19.248769 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-deab6e6d-4697-45ad-9020-f62a96b06914 tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] [instance: 26fdb428-7e41-4e0f-b91a-15009844089f] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:32:19.262914 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-deab6e6d-4697-45ad-9020-f62a96b06914 tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:19.263586 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-deab6e6d-4697-45ad-9020-f62a96b06914 tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:19.264909 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-deab6e6d-4697-45ad-9020-f62a96b06914 tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:19.265636 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-deab6e6d-4697-45ad-9020-f62a96b06914 tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:19.298176 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG dbcounter [-] [117671] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:32:19.463023 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.network.security_group_api [None req-deab6e6d-4697-45ad-9020-f62a96b06914 tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Adding security group 464748d0-cf04-46b0-b8e3-bfb3833aaaa2 to port 60aa1d76-6fda-4493-91ab-da6bd2ca0a42 Jun 16 18:32:19.757653 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-625f834c-3954-4b10-8145-7bcea0a9e1ae tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:32:19.759541 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-625f834c-3954-4b10-8145-7bcea0a9e1ae tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] [instance: 121f052a-2d96-444d-a817-38e348aaf0e5] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:32:19.771351 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-625f834c-3954-4b10-8145-7bcea0a9e1ae tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:19.772279 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-625f834c-3954-4b10-8145-7bcea0a9e1ae tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:19.774353 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-625f834c-3954-4b10-8145-7bcea0a9e1ae tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:19.775397 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-625f834c-3954-4b10-8145-7bcea0a9e1ae tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:19.783283 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG dbcounter [-] [117670] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:32:19.839320 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-625f834c-3954-4b10-8145-7bcea0a9e1ae tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] 10.222.0.30 "GET /compute/v2.1/servers/121f052a-2d96-444d-a817-38e348aaf0e5/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.090093 Jun 16 18:32:19.839992 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 234/425] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Jun 16 18:32:19 2022] GET /compute/v2.1/servers/121f052a-2d96-444d-a817-38e348aaf0e5/os-volume_attachments => generated 25 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 16 18:32:19.934060 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-f8963ddf-c1bc-408e-afb6-749f1c4bdbca tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:32:19.934679 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-f8963ddf-c1bc-408e-afb6-749f1c4bdbca tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] [instance: 121f052a-2d96-444d-a817-38e348aaf0e5] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:32:19.949169 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-f8963ddf-c1bc-408e-afb6-749f1c4bdbca tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:19.949928 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-f8963ddf-c1bc-408e-afb6-749f1c4bdbca tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:19.951446 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-f8963ddf-c1bc-408e-afb6-749f1c4bdbca tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:19.953288 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-f8963ddf-c1bc-408e-afb6-749f1c4bdbca tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:20.011018 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-f8963ddf-c1bc-408e-afb6-749f1c4bdbca tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] [instance: 121f052a-2d96-444d-a817-38e348aaf0e5] Going to try to terminate instance {{(pid=117670) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 18:32:20.125197 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-f8963ddf-c1bc-408e-afb6-749f1c4bdbca tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] 10.222.0.30 "DELETE /compute/v2.1/servers/121f052a-2d96-444d-a817-38e348aaf0e5" status: 204 len: 0 microversion: 2.1 time: 0.197493 Jun 16 18:32:20.126150 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 235/426] 10.222.0.30 () {58 vars in 1238 bytes} [Thu Jun 16 18:32:19 2022] DELETE /compute/v2.1/servers/121f052a-2d96-444d-a817-38e348aaf0e5 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 18:32:20.140650 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-eeeafa36-1ec6-4114-8b7f-bd4164302cfc tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:32:20.141610 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-eeeafa36-1ec6-4114-8b7f-bd4164302cfc tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] [instance: 121f052a-2d96-444d-a817-38e348aaf0e5] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:32:20.148860 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-eeeafa36-1ec6-4114-8b7f-bd4164302cfc tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:20.149292 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-eeeafa36-1ec6-4114-8b7f-bd4164302cfc tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:20.150298 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-eeeafa36-1ec6-4114-8b7f-bd4164302cfc tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:20.150730 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-eeeafa36-1ec6-4114-8b7f-bd4164302cfc tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:20.336518 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-deab6e6d-4697-45ad-9020-f62a96b06914 tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] 10.222.0.30 "POST /compute/v2.1/servers/26fdb428-7e41-4e0f-b91a-15009844089f/action" status: 202 len: 0 microversion: 2.1 time: 1.098918 Jun 16 18:32:20.341918 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 192/427] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Jun 16 18:32:19 2022] POST /compute/v2.1/servers/26fdb428-7e41-4e0f-b91a-15009844089f/action => generated 0 bytes in 1107 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 18:32:20.348480 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-a556f1f3-705e-49ac-bc2b-11db3f488ae7 tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:32:20.349344 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-a556f1f3-705e-49ac-bc2b-11db3f488ae7 tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] [instance: 26fdb428-7e41-4e0f-b91a-15009844089f] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:32:20.357050 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-a556f1f3-705e-49ac-bc2b-11db3f488ae7 tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:20.357801 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-a556f1f3-705e-49ac-bc2b-11db3f488ae7 tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:20.358760 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-a556f1f3-705e-49ac-bc2b-11db3f488ae7 tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:20.359351 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-a556f1f3-705e-49ac-bc2b-11db3f488ae7 tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:20.428130 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-eeeafa36-1ec6-4114-8b7f-bd4164302cfc tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f6c755dbf74640a372802f02733eb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f0473c6214a4428be438fabc530012b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:32:20.439360 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-eeeafa36-1ec6-4114-8b7f-bd4164302cfc tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] 10.222.0.30 "GET /compute/v2.1/servers/121f052a-2d96-444d-a817-38e348aaf0e5" status: 200 len: 1682 microversion: 2.1 time: 0.303475 Jun 16 18:32:20.443937 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 236/428] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:32:20 2022] GET /compute/v2.1/servers/121f052a-2d96-444d-a817-38e348aaf0e5 => generated 1682 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:32:20.445238 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [req-b3910197-e4b0-4ce5-a08d-6d944c98b3b1 req-1028cced-0693-4a40-8b4b-ef48a2d70971 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "26fdb428-7e41-4e0f-b91a-15009844089f", "tag": "60aa1d76-6fda-4493-91ab-da6bd2ca0a42"}]} {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:32:20.455665 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [req-b3910197-e4b0-4ce5-a08d-6d944c98b3b1 req-1028cced-0693-4a40-8b4b-ef48a2d70971 service nova] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:20.456435 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [req-b3910197-e4b0-4ce5-a08d-6d944c98b3b1 req-1028cced-0693-4a40-8b4b-ef48a2d70971 service nova] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:20.474966 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.compute.server_external_events [req-b3910197-e4b0-4ce5-a08d-6d944c98b3b1 req-1028cced-0693-4a40-8b4b-ef48a2d70971 service nova] Creating event network-changed:60aa1d76-6fda-4493-91ab-da6bd2ca0a42 for instance 26fdb428-7e41-4e0f-b91a-15009844089f on hv-cinder-81322 Jun 16 18:32:20.484719 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [req-b3910197-e4b0-4ce5-a08d-6d944c98b3b1 req-1028cced-0693-4a40-8b4b-ef48a2d70971 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042612 Jun 16 18:32:20.486553 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 237/429] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Jun 16 18:32:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:32:20.629647 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-a556f1f3-705e-49ac-bc2b-11db3f488ae7 tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7d57c4231b49b28a606a17e42267e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9fa2caa1412451aa0308c807d5c62d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:32:20.653656 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-a556f1f3-705e-49ac-bc2b-11db3f488ae7 tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] 10.222.0.30 "GET /compute/v2.1/servers/26fdb428-7e41-4e0f-b91a-15009844089f" status: 200 len: 1759 microversion: 2.1 time: 0.309568 Jun 16 18:32:20.654531 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 193/430] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:32:20 2022] GET /compute/v2.1/servers/26fdb428-7e41-4e0f-b91a-15009844089f => generated 1759 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:32:21.459554 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-7e5e0830-5abe-4baf-abec-f88667478146 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:32:21.461043 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-7e5e0830-5abe-4baf-abec-f88667478146 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] [instance: 121f052a-2d96-444d-a817-38e348aaf0e5] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:32:21.468850 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-7e5e0830-5abe-4baf-abec-f88667478146 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:21.469445 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-7e5e0830-5abe-4baf-abec-f88667478146 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:21.470362 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-7e5e0830-5abe-4baf-abec-f88667478146 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:21.470839 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-7e5e0830-5abe-4baf-abec-f88667478146 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:21.667344 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-7e5e0830-5abe-4baf-abec-f88667478146 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f6c755dbf74640a372802f02733eb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f0473c6214a4428be438fabc530012b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:32:21.676739 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-7e5e0830-5abe-4baf-abec-f88667478146 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] 10.222.0.30 "GET /compute/v2.1/servers/121f052a-2d96-444d-a817-38e348aaf0e5" status: 200 len: 1682 microversion: 2.1 time: 0.222932 Jun 16 18:32:21.677327 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 238/431] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:32:21 2022] GET /compute/v2.1/servers/121f052a-2d96-444d-a817-38e348aaf0e5 => generated 1682 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:32:22.698372 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-797937f4-0c56-407d-a7a5-93fb653678ee tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:32:22.699545 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-797937f4-0c56-407d-a7a5-93fb653678ee tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] [instance: 121f052a-2d96-444d-a817-38e348aaf0e5] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:32:22.714175 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-797937f4-0c56-407d-a7a5-93fb653678ee tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:22.714766 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-797937f4-0c56-407d-a7a5-93fb653678ee tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:22.715839 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-797937f4-0c56-407d-a7a5-93fb653678ee tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:22.716452 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-797937f4-0c56-407d-a7a5-93fb653678ee tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:22.839679 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-797937f4-0c56-407d-a7a5-93fb653678ee tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f6c755dbf74640a372802f02733eb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f0473c6214a4428be438fabc530012b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:32:22.851175 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-797937f4-0c56-407d-a7a5-93fb653678ee tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] 10.222.0.30 "GET /compute/v2.1/servers/121f052a-2d96-444d-a817-38e348aaf0e5" status: 200 len: 1614 microversion: 2.1 time: 0.160250 Jun 16 18:32:22.853503 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 194/432] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:32:22 2022] GET /compute/v2.1/servers/121f052a-2d96-444d-a817-38e348aaf0e5 => generated 1614 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:32:23.167185 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [req-35de1562-5f45-4d75-8b58-b509e73a3650 req-408945cd-40e4-4eb1-9053-f80bfc98d883 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "121f052a-2d96-444d-a817-38e348aaf0e5", "name": "network-vif-deleted", "tag": "0075a21e-8596-4b59-b394-0d2e2c21aab0"}]} {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:32:23.182968 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [req-35de1562-5f45-4d75-8b58-b509e73a3650 req-408945cd-40e4-4eb1-9053-f80bfc98d883 service nova] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:23.183641 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [req-35de1562-5f45-4d75-8b58-b509e73a3650 req-408945cd-40e4-4eb1-9053-f80bfc98d883 service nova] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:23.200098 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.compute.server_external_events [req-35de1562-5f45-4d75-8b58-b509e73a3650 req-408945cd-40e4-4eb1-9053-f80bfc98d883 service nova] Creating event network-vif-deleted:0075a21e-8596-4b59-b394-0d2e2c21aab0 for instance 121f052a-2d96-444d-a817-38e348aaf0e5 on hv-cinder-81322 Jun 16 18:32:23.206960 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [req-35de1562-5f45-4d75-8b58-b509e73a3650 req-408945cd-40e4-4eb1-9053-f80bfc98d883 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047970 Jun 16 18:32:23.208406 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 239/433] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Jun 16 18:32:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:32:23.871961 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-d16d4d52-5a4d-4d60-a7fb-43457f19dd19 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:32:23.872674 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-d16d4d52-5a4d-4d60-a7fb-43457f19dd19 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] [instance: 121f052a-2d96-444d-a817-38e348aaf0e5] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:32:23.880007 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-d16d4d52-5a4d-4d60-a7fb-43457f19dd19 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:23.880541 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-d16d4d52-5a4d-4d60-a7fb-43457f19dd19 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:23.881457 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-d16d4d52-5a4d-4d60-a7fb-43457f19dd19 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:23.882007 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-d16d4d52-5a4d-4d60-a7fb-43457f19dd19 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:23.900459 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.wsgi [None req-d16d4d52-5a4d-4d60-a7fb-43457f19dd19 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] HTTP exception thrown: Instance 121f052a-2d96-444d-a817-38e348aaf0e5 could not be found. Jun 16 18:32:23.902373 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-d16d4d52-5a4d-4d60-a7fb-43457f19dd19 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Request method failure captured: Jun 16 18:32:23.902373 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: request: GET /compute/v2.1/servers/121f052a-2d96-444d-a817-38e348aaf0e5 HTTP/1.1 Jun 16 18:32:23.902373 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: Accept: application/json Jun 16 18:32:23.902373 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: Accept-Encoding: identity Jun 16 18:32:23.902373 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: Connection: close Jun 16 18:32:23.902373 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: Content-Length: 0 Jun 16 18:32:23.902373 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: Content-Type: application/json Jun 16 18:32:23.902373 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: Host: 10.222.0.30 Jun 16 18:32:23.902373 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: Openstack-System-Scope: None Jun 16 18:32:23.902373 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: User-Agent: python-urllib3/1.26.9 Jun 16 18:32:23.902373 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Auth-Token: gAAAAABiq3ZX0T5cncUq62ubfwO6lq1Lv4hHDbhnjkkOIJCFH6tDdIm4lTs2-IIDJl9nzK-SwFmooLj6i7tKw5uiIiGwCsi7P_mYy-sE7ccdLwqhACdzBDGvbvHDziedNnH_4yw_ULKqsIs-KqEoe_8V5KONSdInylhgSWkEXyoNm7uUe3r64xc Jun 16 18:32:23.902373 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Domain-Id: None Jun 16 18:32:23.902373 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Domain-Name: None Jun 16 18:32:23.902373 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Identity-Status: Confirmed Jun 16 18:32:23.902373 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Is-Admin-Project: True Jun 16 18:32:23.902373 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Project-Domain-Id: default Jun 16 18:32:23.902373 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Project-Domain-Name: Default Jun 16 18:32:23.902373 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Project-Id: 1f0473c6214a4428be438fabc530012b Jun 16 18:32:23.902373 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Project-Name: tempest-AttachVolumeNegativeTest-1927047282 Jun 16 18:32:23.902373 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Role: reader,member Jun 16 18:32:23.902373 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Roles: reader,member Jun 16 18:32:23.903958 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/1f0473c6214a4428be438fabc530012b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/1f0473c6214a4428be438fabc530012b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_1f0473c6214a4428be438fabc530012b", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/1f0473c6214a4428be438fabc530012b"}]}] Jun 16 18:32:23.903958 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Tenant: tempest-AttachVolumeNegativeTest-1927047282 Jun 16 18:32:23.903958 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Tenant-Id: 1f0473c6214a4428be438fabc530012b Jun 16 18:32:23.903958 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1927047282 Jun 16 18:32:23.903958 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-User: tempest-AttachVolumeNegativeTest-1927047282-project Jun 16 18:32:23.903958 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-User-Domain-Id: default Jun 16 18:32:23.903958 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-User-Domain-Name: Default Jun 16 18:32:23.903958 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-User-Id: 89f6c755dbf74640a372802f02733eb3 Jun 16 18:32:23.903958 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-User-Name: tempest-AttachVolumeNegativeTest-1927047282-project Jun 16 18:32:23.903958 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: method: > Jun 16 18:32:23.903958 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: exception: Instance 121f052a-2d96-444d-a817-38e348aaf0e5 could not be found. Jun 16 18:32:23.903958 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: action_args: {'id': '121f052a-2d96-444d-a817-38e348aaf0e5'} Jun 16 18:32:23.904873 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:32:23.904873 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:32:23.904873 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 18:32:23.904873 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 18:32:23.904873 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 18:32:23.904873 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 18:32:23.904873 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 18:32:23.904873 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 18:32:23.904873 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 18:32:23.904873 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 18:32:23.904873 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 121f052a-2d96-444d-a817-38e348aaf0e5 could not be found. Jun 16 18:32:23.904873 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Jun 16 18:32:23.904873 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:32:23.904873 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Jun 16 18:32:23.904873 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:32:23.904873 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:32:23.904873 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:32:23.904873 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:32:23.904873 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:32:23.904873 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:32:23.906800 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:32:23.906800 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 18:32:23.906800 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 18:32:23.906800 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 18:32:23.906800 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 18:32:23.906800 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 18:32:23.906800 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:32:23.906800 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 121f052a-2d96-444d-a817-38e348aaf0e5 could not be found. Jun 16 18:32:23.906800 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Jun 16 18:32:23.906800 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:32:23.906800 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Jun 16 18:32:23.906800 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:32:23.906800 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:32:23.906800 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:32:23.906800 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:32:23.906800 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:32:23.906800 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 121f052a-2d96-444d-a817-38e348aaf0e5 could not be found. Jun 16 18:32:23.906800 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Jun 16 18:32:23.909017 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-d16d4d52-5a4d-4d60-a7fb-43457f19dd19 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Returning 404 to user: Instance 121f052a-2d96-444d-a817-38e348aaf0e5 could not be found. {{(pid=117671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:32:23.910122 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-d16d4d52-5a4d-4d60-a7fb-43457f19dd19 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] 10.222.0.30 "GET /compute/v2.1/servers/121f052a-2d96-444d-a817-38e348aaf0e5" status: 404 len: 111 microversion: 2.1 time: 0.042299 Jun 16 18:32:23.915281 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 195/434] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:32:23 2022] GET /compute/v2.1/servers/121f052a-2d96-444d-a817-38e348aaf0e5 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:32:23.923448 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-2dc1debe-709a-4b93-b6a4-9bde17cba58e tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Calling method '.version_select at 0x7fbb23e8ec10>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:32:23.948783 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-2dc1debe-709a-4b93-b6a4-9bde17cba58e tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2081235105" status: 202 len: 0 microversion: 2.1 time: 0.031311 Jun 16 18:32:23.949784 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 240/435] 10.222.0.30 () {58 vars in 1220 bytes} [Thu Jun 16 18:32:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2081235105 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 18:32:24.828778 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-8c2c15e4-f6df-4e82-9617-8ca16243800d tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Action: 'create', calling method: .version_select at 0x7fbb23f5c3a0>, body: {"keypair": {"name": "tempest-keypair-306961846", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLUZVEMqTuLcXGjZQw6Ty0Z3yA2G69YpmlN0OTwlpdc6/1crHwQ1EJIHGJXIQh0iVrRZLIhSJdkTmZy33XiqGdZQOblc/+INV8iIZOf2w0qKUQL7xzdCD5WeH600/7eXhQ=="}} {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:32:24.850484 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.quota [None req-8c2c15e4-f6df-4e82-9617-8ca16243800d tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Getting quotas for project 1f0473c6214a4428be438fabc530012b. Resources: {'key_pairs'} {{(pid=117671) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 18:32:24.857732 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.quota [None req-8c2c15e4-f6df-4e82-9617-8ca16243800d tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Getting quotas for user 89f6c755dbf74640a372802f02733eb3 and project 1f0473c6214a4428be438fabc530012b. Resources: {'key_pairs'} {{(pid=117671) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 18:32:24.891859 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-8c2c15e4-f6df-4e82-9617-8ca16243800d tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.069504 Jun 16 18:32:24.892861 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 196/436] 10.222.0.30 () {60 vars in 1158 bytes} [Thu Jun 16 18:32:24 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:32:26.617176 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-7c59c990-5914-49f3-ba8f-9cb7fdc22b15 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1448258106", "imageRef": "38ef083a-a9ff-4836-8954-f770268ba205", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8dc64fea-6d01-44bc-9636-d5525e5d1ec1"}], "security_groups": [{"name": "tempest-securitygroup--201176820"}], "key_name": "tempest-keypair-306961846", "user_data": "}} {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:32:26.746796 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.network.neutron [None req-7c59c990-5914-49f3-ba8f-9cb7fdc22b15 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] validate_networks() for [('8dc64fea-6d01-44bc-9636-d5525e5d1ec1', None, None, None, None, None)] {{(pid=117670) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 18:32:27.231594 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.virt.hardware [None req-7c59c990-5914-49f3-ba8f-9cb7fdc22b15 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Flavor limits 0:0:0 {{(pid=117670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 18:32:27.232013 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.virt.hardware [None req-7c59c990-5914-49f3-ba8f-9cb7fdc22b15 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Image limits 0:0:0 {{(pid=117670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 18:32:27.232530 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.virt.hardware [None req-7c59c990-5914-49f3-ba8f-9cb7fdc22b15 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Flavor pref 0:0:0 {{(pid=117670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 18:32:27.232949 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.virt.hardware [None req-7c59c990-5914-49f3-ba8f-9cb7fdc22b15 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Image pref 0:0:0 {{(pid=117670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 18:32:27.233729 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.virt.hardware [None req-7c59c990-5914-49f3-ba8f-9cb7fdc22b15 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 18:32:27.246565 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-7c59c990-5914-49f3-ba8f-9cb7fdc22b15 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:27.247010 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-7c59c990-5914-49f3-ba8f-9cb7fdc22b15 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:27.247824 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-7c59c990-5914-49f3-ba8f-9cb7fdc22b15 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:27.248286 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-7c59c990-5914-49f3-ba8f-9cb7fdc22b15 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:27.270299 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.quota [None req-7c59c990-5914-49f3-ba8f-9cb7fdc22b15 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Getting quotas for project 1f0473c6214a4428be438fabc530012b. Resources: {'instances', 'ram', 'cores'} {{(pid=117670) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 18:32:27.275479 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.quota [None req-7c59c990-5914-49f3-ba8f-9cb7fdc22b15 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Getting quotas for user 89f6c755dbf74640a372802f02733eb3 and project 1f0473c6214a4428be438fabc530012b. Resources: {'instances', 'ram', 'cores'} {{(pid=117670) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 18:32:27.288444 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-7c59c990-5914-49f3-ba8f-9cb7fdc22b15 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Going to run 1 instances... {{(pid=117670) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 18:32:27.292424 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-7c59c990-5914-49f3-ba8f-9cb7fdc22b15 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] [instance: e5de32bc-4cf2-47cd-b0de-bcc77b9a5791] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='38ef083a-a9ff-4836-8954-f770268ba205',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117670) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 18:32:27.348254 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-7c59c990-5914-49f3-ba8f-9cb7fdc22b15 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.741426 Jun 16 18:32:27.349350 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 241/437] 10.222.0.30 () {60 vars in 1146 bytes} [Thu Jun 16 18:32:26 2022] POST /compute/v2.1/servers => generated 401 bytes in 744 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 18:32:27.367553 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-b09d7056-66d0-4773-b5ca-82612ee11f40 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:32:27.370050 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-b09d7056-66d0-4773-b5ca-82612ee11f40 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] [instance: e5de32bc-4cf2-47cd-b0de-bcc77b9a5791] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:32:27.453444 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-b09d7056-66d0-4773-b5ca-82612ee11f40 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f6c755dbf74640a372802f02733eb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f0473c6214a4428be438fabc530012b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:32:27.472809 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-b09d7056-66d0-4773-b5ca-82612ee11f40 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] 10.222.0.30 "GET /compute/v2.1/servers/e5de32bc-4cf2-47cd-b0de-bcc77b9a5791" status: 200 len: 1241 microversion: 2.1 time: 0.109746 Jun 16 18:32:27.473937 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 197/438] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:32:27 2022] GET /compute/v2.1/servers/e5de32bc-4cf2-47cd-b0de-bcc77b9a5791 => generated 1241 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:32:28.517315 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-065ffae1-7cb1-40eb-bdbd-ccc3ab739e0f tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:32:28.518659 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-065ffae1-7cb1-40eb-bdbd-ccc3ab739e0f tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] [instance: e5de32bc-4cf2-47cd-b0de-bcc77b9a5791] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:32:28.531564 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-065ffae1-7cb1-40eb-bdbd-ccc3ab739e0f tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:28.532228 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-065ffae1-7cb1-40eb-bdbd-ccc3ab739e0f tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:28.533152 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-065ffae1-7cb1-40eb-bdbd-ccc3ab739e0f tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:28.533713 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-065ffae1-7cb1-40eb-bdbd-ccc3ab739e0f tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:28.661816 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-065ffae1-7cb1-40eb-bdbd-ccc3ab739e0f tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f6c755dbf74640a372802f02733eb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f0473c6214a4428be438fabc530012b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:32:28.676619 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-065ffae1-7cb1-40eb-bdbd-ccc3ab739e0f tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] 10.222.0.30 "GET /compute/v2.1/servers/e5de32bc-4cf2-47cd-b0de-bcc77b9a5791" status: 200 len: 1293 microversion: 2.1 time: 0.167478 Jun 16 18:32:28.678095 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 242/439] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:32:28 2022] GET /compute/v2.1/servers/e5de32bc-4cf2-47cd-b0de-bcc77b9a5791 => generated 1293 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:32:29.708068 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-e9269611-4f3e-4ea8-a460-9fb7819300a7 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:32:29.710268 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-e9269611-4f3e-4ea8-a460-9fb7819300a7 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] [instance: e5de32bc-4cf2-47cd-b0de-bcc77b9a5791] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:32:29.732535 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-e9269611-4f3e-4ea8-a460-9fb7819300a7 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:29.734801 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-e9269611-4f3e-4ea8-a460-9fb7819300a7 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:29.737765 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-e9269611-4f3e-4ea8-a460-9fb7819300a7 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:29.739208 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-e9269611-4f3e-4ea8-a460-9fb7819300a7 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:30.108042 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-e9269611-4f3e-4ea8-a460-9fb7819300a7 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f6c755dbf74640a372802f02733eb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f0473c6214a4428be438fabc530012b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:32:30.122179 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-e9269611-4f3e-4ea8-a460-9fb7819300a7 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] 10.222.0.30 "GET /compute/v2.1/servers/e5de32bc-4cf2-47cd-b0de-bcc77b9a5791" status: 200 len: 1366 microversion: 2.1 time: 0.421752 Jun 16 18:32:30.123206 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 198/440] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:32:29 2022] GET /compute/v2.1/servers/e5de32bc-4cf2-47cd-b0de-bcc77b9a5791 => generated 1366 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:32:30.707656 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [req-f7ec16b6-3d71-4fcd-8395-b43897077ded req-0bc2e8a7-f757-4366-aa09-e6d4c3608095 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e5de32bc-4cf2-47cd-b0de-bcc77b9a5791", "tag": "2e698a2a-6a45-4d55-a4e3-1a1a739951af"}]} {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:32:30.729379 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [req-f7ec16b6-3d71-4fcd-8395-b43897077ded req-0bc2e8a7-f757-4366-aa09-e6d4c3608095 service nova] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:30.730539 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [req-f7ec16b6-3d71-4fcd-8395-b43897077ded req-0bc2e8a7-f757-4366-aa09-e6d4c3608095 service nova] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:30.753177 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.compute.server_external_events [req-f7ec16b6-3d71-4fcd-8395-b43897077ded req-0bc2e8a7-f757-4366-aa09-e6d4c3608095 service nova] Creating event network-changed:2e698a2a-6a45-4d55-a4e3-1a1a739951af for instance e5de32bc-4cf2-47cd-b0de-bcc77b9a5791 on hv-cinder-81322 Jun 16 18:32:30.762205 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [req-f7ec16b6-3d71-4fcd-8395-b43897077ded req-0bc2e8a7-f757-4366-aa09-e6d4c3608095 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068694 Jun 16 18:32:30.763577 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 243/441] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Jun 16 18:32:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:32:31.149472 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-c001c28d-7092-4323-a830-5b7f3034b919 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:32:31.150489 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-c001c28d-7092-4323-a830-5b7f3034b919 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] [instance: e5de32bc-4cf2-47cd-b0de-bcc77b9a5791] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:32:31.153683 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG dbcounter [-] [117671] Writing DB stats nova_api:SELECT=62,nova_api:INSERT=1 {{(pid=117671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:32:31.161989 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-c001c28d-7092-4323-a830-5b7f3034b919 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:31.162547 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-c001c28d-7092-4323-a830-5b7f3034b919 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:31.163882 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-c001c28d-7092-4323-a830-5b7f3034b919 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:31.164809 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-c001c28d-7092-4323-a830-5b7f3034b919 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:31.439068 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-c001c28d-7092-4323-a830-5b7f3034b919 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f6c755dbf74640a372802f02733eb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f0473c6214a4428be438fabc530012b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:32:31.453620 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-c001c28d-7092-4323-a830-5b7f3034b919 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] 10.222.0.30 "GET /compute/v2.1/servers/e5de32bc-4cf2-47cd-b0de-bcc77b9a5791" status: 200 len: 1366 microversion: 2.1 time: 0.308794 Jun 16 18:32:31.454660 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 199/442] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:32:31 2022] GET /compute/v2.1/servers/e5de32bc-4cf2-47cd-b0de-bcc77b9a5791 => generated 1366 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:32:32.480106 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-6c54d4cc-c83e-4f98-932d-59dd80602369 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:32:32.481111 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-6c54d4cc-c83e-4f98-932d-59dd80602369 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] [instance: e5de32bc-4cf2-47cd-b0de-bcc77b9a5791] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:32:32.488207 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-6c54d4cc-c83e-4f98-932d-59dd80602369 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:32.488656 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-6c54d4cc-c83e-4f98-932d-59dd80602369 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:32.489436 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-6c54d4cc-c83e-4f98-932d-59dd80602369 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:32.489869 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-6c54d4cc-c83e-4f98-932d-59dd80602369 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:32.641318 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-6c54d4cc-c83e-4f98-932d-59dd80602369 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f6c755dbf74640a372802f02733eb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f0473c6214a4428be438fabc530012b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:32:32.651098 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-6c54d4cc-c83e-4f98-932d-59dd80602369 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] 10.222.0.30 "GET /compute/v2.1/servers/e5de32bc-4cf2-47cd-b0de-bcc77b9a5791" status: 200 len: 1366 microversion: 2.1 time: 0.176162 Jun 16 18:32:32.651686 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 244/443] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:32:32 2022] GET /compute/v2.1/servers/e5de32bc-4cf2-47cd-b0de-bcc77b9a5791 => generated 1366 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:32:33.668808 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-3f8d522e-0097-4aee-96a6-2fdd129d6f0d tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:32:33.669432 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-3f8d522e-0097-4aee-96a6-2fdd129d6f0d tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] [instance: e5de32bc-4cf2-47cd-b0de-bcc77b9a5791] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:32:33.676460 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-3f8d522e-0097-4aee-96a6-2fdd129d6f0d tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:33.676916 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-3f8d522e-0097-4aee-96a6-2fdd129d6f0d tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:33.677702 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-3f8d522e-0097-4aee-96a6-2fdd129d6f0d tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:33.678144 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-3f8d522e-0097-4aee-96a6-2fdd129d6f0d tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:33.834323 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-3f8d522e-0097-4aee-96a6-2fdd129d6f0d tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f6c755dbf74640a372802f02733eb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f0473c6214a4428be438fabc530012b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:32:33.843010 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-3f8d522e-0097-4aee-96a6-2fdd129d6f0d tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] 10.222.0.30 "GET /compute/v2.1/servers/e5de32bc-4cf2-47cd-b0de-bcc77b9a5791" status: 200 len: 1366 microversion: 2.1 time: 0.178128 Jun 16 18:32:33.843921 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 200/444] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:32:33 2022] GET /compute/v2.1/servers/e5de32bc-4cf2-47cd-b0de-bcc77b9a5791 => generated 1366 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:32:34.791875 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-f20fb31b-64a3-480c-8218-ce72fa51d80f tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:32:34.792894 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-f20fb31b-64a3-480c-8218-ce72fa51d80f tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] [instance: 26fdb428-7e41-4e0f-b91a-15009844089f] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:32:34.800474 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-f20fb31b-64a3-480c-8218-ce72fa51d80f tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:34.801142 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-f20fb31b-64a3-480c-8218-ce72fa51d80f tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:34.802152 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-f20fb31b-64a3-480c-8218-ce72fa51d80f tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:34.802604 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-f20fb31b-64a3-480c-8218-ce72fa51d80f tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:34.873745 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-67f98c73-51d1-47a2-a7c1-d47d4860b78c tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:32:34.873745 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-67f98c73-51d1-47a2-a7c1-d47d4860b78c tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] [instance: e5de32bc-4cf2-47cd-b0de-bcc77b9a5791] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:32:34.878812 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-67f98c73-51d1-47a2-a7c1-d47d4860b78c tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:34.879240 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-67f98c73-51d1-47a2-a7c1-d47d4860b78c tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:34.880422 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-67f98c73-51d1-47a2-a7c1-d47d4860b78c tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:34.880931 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-67f98c73-51d1-47a2-a7c1-d47d4860b78c tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:34.899349 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-f20fb31b-64a3-480c-8218-ce72fa51d80f tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] 10.222.0.30 "POST /compute/v2.1/servers/26fdb428-7e41-4e0f-b91a-15009844089f/action" status: 202 len: 0 microversion: 2.1 time: 0.112069 Jun 16 18:32:34.904026 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 245/445] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Jun 16 18:32:34 2022] POST /compute/v2.1/servers/26fdb428-7e41-4e0f-b91a-15009844089f/action => generated 0 bytes in 118 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 18:32:34.911201 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-1a549aa5-790e-4a00-8efc-c3523c68fe29 tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:32:34.912017 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-1a549aa5-790e-4a00-8efc-c3523c68fe29 tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] [instance: 26fdb428-7e41-4e0f-b91a-15009844089f] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:32:34.920941 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-1a549aa5-790e-4a00-8efc-c3523c68fe29 tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:34.920941 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-1a549aa5-790e-4a00-8efc-c3523c68fe29 tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:34.921543 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-1a549aa5-790e-4a00-8efc-c3523c68fe29 tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:34.922240 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-1a549aa5-790e-4a00-8efc-c3523c68fe29 tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:35.118438 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-67f98c73-51d1-47a2-a7c1-d47d4860b78c tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f6c755dbf74640a372802f02733eb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f0473c6214a4428be438fabc530012b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:32:35.133770 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-67f98c73-51d1-47a2-a7c1-d47d4860b78c tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] 10.222.0.30 "GET /compute/v2.1/servers/e5de32bc-4cf2-47cd-b0de-bcc77b9a5791" status: 200 len: 1366 microversion: 2.1 time: 0.268421 Jun 16 18:32:35.135281 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 201/446] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:32:34 2022] GET /compute/v2.1/servers/e5de32bc-4cf2-47cd-b0de-bcc77b9a5791 => generated 1366 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:32:35.162677 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-1a549aa5-790e-4a00-8efc-c3523c68fe29 tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7d57c4231b49b28a606a17e42267e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9fa2caa1412451aa0308c807d5c62d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:32:35.178325 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-1a549aa5-790e-4a00-8efc-c3523c68fe29 tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] 10.222.0.30 "GET /compute/v2.1/servers/26fdb428-7e41-4e0f-b91a-15009844089f" status: 200 len: 1751 microversion: 2.1 time: 0.272415 Jun 16 18:32:35.180489 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 246/447] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:32:34 2022] GET /compute/v2.1/servers/26fdb428-7e41-4e0f-b91a-15009844089f => generated 1751 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:32:36.161425 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-392da84d-b951-4fdb-9ec9-8feeed8fdfdf tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:32:36.162043 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-392da84d-b951-4fdb-9ec9-8feeed8fdfdf tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] [instance: e5de32bc-4cf2-47cd-b0de-bcc77b9a5791] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:32:36.169340 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-392da84d-b951-4fdb-9ec9-8feeed8fdfdf tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:36.169788 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-392da84d-b951-4fdb-9ec9-8feeed8fdfdf tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:36.170821 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-392da84d-b951-4fdb-9ec9-8feeed8fdfdf tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:36.171257 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-392da84d-b951-4fdb-9ec9-8feeed8fdfdf tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:36.207133 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-4ddd5f3c-3e57-4650-8d63-96140cee868d tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:32:36.207757 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-4ddd5f3c-3e57-4650-8d63-96140cee868d tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] [instance: 26fdb428-7e41-4e0f-b91a-15009844089f] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:32:36.209886 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG dbcounter [-] [117670] Writing DB stats nova_api:SELECT=79,nova_api:UPDATE=2,nova_api:DELETE=2,nova_api:INSERT=3 {{(pid=117670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:32:36.217178 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-4ddd5f3c-3e57-4650-8d63-96140cee868d tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:36.217630 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-4ddd5f3c-3e57-4650-8d63-96140cee868d tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:36.218408 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-4ddd5f3c-3e57-4650-8d63-96140cee868d tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:36.218851 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-4ddd5f3c-3e57-4650-8d63-96140cee868d tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:36.381816 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-392da84d-b951-4fdb-9ec9-8feeed8fdfdf tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f6c755dbf74640a372802f02733eb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f0473c6214a4428be438fabc530012b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:32:36.400552 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-392da84d-b951-4fdb-9ec9-8feeed8fdfdf tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] 10.222.0.30 "GET /compute/v2.1/servers/e5de32bc-4cf2-47cd-b0de-bcc77b9a5791" status: 200 len: 1366 microversion: 2.1 time: 0.242714 Jun 16 18:32:36.401362 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 202/448] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:32:36 2022] GET /compute/v2.1/servers/e5de32bc-4cf2-47cd-b0de-bcc77b9a5791 => generated 1366 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:32:36.437934 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-4ddd5f3c-3e57-4650-8d63-96140cee868d tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7d57c4231b49b28a606a17e42267e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9fa2caa1412451aa0308c807d5c62d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:32:36.454010 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-4ddd5f3c-3e57-4650-8d63-96140cee868d tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] 10.222.0.30 "GET /compute/v2.1/servers/26fdb428-7e41-4e0f-b91a-15009844089f" status: 200 len: 1756 microversion: 2.1 time: 0.250792 Jun 16 18:32:36.454618 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 247/449] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:32:36 2022] GET /compute/v2.1/servers/26fdb428-7e41-4e0f-b91a-15009844089f => generated 1756 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:32:36.627015 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [req-9709429c-ea9e-482b-bb55-5bb6a415dc47 req-d016797a-58af-46ad-b58a-bd2a43860b2c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5de32bc-4cf2-47cd-b0de-bcc77b9a5791", "name": "network-vif-plugged", "status": "completed", "tag": "2e698a2a-6a45-4d55-a4e3-1a1a739951af"}]} {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:32:36.636977 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [req-9709429c-ea9e-482b-bb55-5bb6a415dc47 req-d016797a-58af-46ad-b58a-bd2a43860b2c service nova] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:36.637258 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [req-9709429c-ea9e-482b-bb55-5bb6a415dc47 req-d016797a-58af-46ad-b58a-bd2a43860b2c service nova] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:36.653053 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.compute.server_external_events [req-9709429c-ea9e-482b-bb55-5bb6a415dc47 req-d016797a-58af-46ad-b58a-bd2a43860b2c service nova] Creating event network-vif-plugged:2e698a2a-6a45-4d55-a4e3-1a1a739951af for instance e5de32bc-4cf2-47cd-b0de-bcc77b9a5791 on hv-cinder-81322 Jun 16 18:32:36.658164 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [req-9709429c-ea9e-482b-bb55-5bb6a415dc47 req-d016797a-58af-46ad-b58a-bd2a43860b2c service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034931 Jun 16 18:32:36.659089 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 203/450] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Jun 16 18:32:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:32:37.423762 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-2260155f-7f42-4c70-9573-ce40e3a46ca0 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:32:37.424605 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-2260155f-7f42-4c70-9573-ce40e3a46ca0 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] [instance: e5de32bc-4cf2-47cd-b0de-bcc77b9a5791] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:32:37.427724 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG dbcounter [-] [117670] Writing DB stats nova_cell0:SELECT=2 {{(pid=117670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:32:37.428447 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG dbcounter [-] [117670] Writing DB stats nova_cell0:SELECT=6 {{(pid=117670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:32:37.435908 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-2260155f-7f42-4c70-9573-ce40e3a46ca0 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:37.436431 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-2260155f-7f42-4c70-9573-ce40e3a46ca0 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:37.437248 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-2260155f-7f42-4c70-9573-ce40e3a46ca0 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:37.437723 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-2260155f-7f42-4c70-9573-ce40e3a46ca0 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:37.470912 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG dbcounter [-] [117671] Writing DB stats nova_cell0:SELECT=6 {{(pid=117671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:32:37.475286 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-cae0eaa0-da3a-4423-9bdc-68c5382ef0ab tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:32:37.476587 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-cae0eaa0-da3a-4423-9bdc-68c5382ef0ab tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] [instance: 26fdb428-7e41-4e0f-b91a-15009844089f] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:32:37.484317 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-cae0eaa0-da3a-4423-9bdc-68c5382ef0ab tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:37.484779 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-cae0eaa0-da3a-4423-9bdc-68c5382ef0ab tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:37.485581 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-cae0eaa0-da3a-4423-9bdc-68c5382ef0ab tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:37.486019 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-cae0eaa0-da3a-4423-9bdc-68c5382ef0ab tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:37.597091 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-2260155f-7f42-4c70-9573-ce40e3a46ca0 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f6c755dbf74640a372802f02733eb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f0473c6214a4428be438fabc530012b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:32:37.610450 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-2260155f-7f42-4c70-9573-ce40e3a46ca0 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] 10.222.0.30 "GET /compute/v2.1/servers/e5de32bc-4cf2-47cd-b0de-bcc77b9a5791" status: 200 len: 1366 microversion: 2.1 time: 0.191660 Jun 16 18:32:37.611249 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 248/451] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:32:37 2022] GET /compute/v2.1/servers/e5de32bc-4cf2-47cd-b0de-bcc77b9a5791 => generated 1366 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:32:37.720106 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-cae0eaa0-da3a-4423-9bdc-68c5382ef0ab tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7d57c4231b49b28a606a17e42267e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9fa2caa1412451aa0308c807d5c62d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:32:37.729515 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-cae0eaa0-da3a-4423-9bdc-68c5382ef0ab tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] 10.222.0.30 "GET /compute/v2.1/servers/26fdb428-7e41-4e0f-b91a-15009844089f" status: 200 len: 1756 microversion: 2.1 time: 0.259881 Jun 16 18:32:37.730127 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 204/452] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:32:37 2022] GET /compute/v2.1/servers/26fdb428-7e41-4e0f-b91a-15009844089f => generated 1756 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:32:38.631640 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-b5084855-f9cc-4124-bab1-9a151f4fd71d tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:32:38.633113 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-b5084855-f9cc-4124-bab1-9a151f4fd71d tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] [instance: e5de32bc-4cf2-47cd-b0de-bcc77b9a5791] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:32:38.641111 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-b5084855-f9cc-4124-bab1-9a151f4fd71d tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:38.641692 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-b5084855-f9cc-4124-bab1-9a151f4fd71d tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:38.642494 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-b5084855-f9cc-4124-bab1-9a151f4fd71d tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:38.642929 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-b5084855-f9cc-4124-bab1-9a151f4fd71d tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:38.748275 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-9cea36e5-9b27-4a8d-969c-7027b55a663d tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:32:38.749480 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-9cea36e5-9b27-4a8d-969c-7027b55a663d tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] [instance: 26fdb428-7e41-4e0f-b91a-15009844089f] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:32:38.756341 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-9cea36e5-9b27-4a8d-969c-7027b55a663d tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:38.756792 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-9cea36e5-9b27-4a8d-969c-7027b55a663d tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:38.757705 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-9cea36e5-9b27-4a8d-969c-7027b55a663d tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:38.758271 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-9cea36e5-9b27-4a8d-969c-7027b55a663d tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:38.818872 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-b5084855-f9cc-4124-bab1-9a151f4fd71d tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f6c755dbf74640a372802f02733eb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f0473c6214a4428be438fabc530012b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:32:38.828708 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-b5084855-f9cc-4124-bab1-9a151f4fd71d tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] 10.222.0.30 "GET /compute/v2.1/servers/e5de32bc-4cf2-47cd-b0de-bcc77b9a5791" status: 200 len: 1555 microversion: 2.1 time: 0.200667 Jun 16 18:32:38.835784 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 249/453] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:32:38 2022] GET /compute/v2.1/servers/e5de32bc-4cf2-47cd-b0de-bcc77b9a5791 => generated 1555 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:32:38.857159 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-5ed73094-883b-4f9b-a754-85151458a467 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:32:38.858013 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-5ed73094-883b-4f9b-a754-85151458a467 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] [instance: e5de32bc-4cf2-47cd-b0de-bcc77b9a5791] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:32:38.872364 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-5ed73094-883b-4f9b-a754-85151458a467 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:38.873137 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-5ed73094-883b-4f9b-a754-85151458a467 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:38.874530 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-5ed73094-883b-4f9b-a754-85151458a467 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:38.875282 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-5ed73094-883b-4f9b-a754-85151458a467 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:38.946393 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-9cea36e5-9b27-4a8d-969c-7027b55a663d tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7d57c4231b49b28a606a17e42267e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9fa2caa1412451aa0308c807d5c62d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:32:38.961630 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-9cea36e5-9b27-4a8d-969c-7027b55a663d tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] 10.222.0.30 "GET /compute/v2.1/servers/26fdb428-7e41-4e0f-b91a-15009844089f" status: 200 len: 1756 microversion: 2.1 time: 0.217788 Jun 16 18:32:38.962727 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 205/454] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:32:38 2022] GET /compute/v2.1/servers/26fdb428-7e41-4e0f-b91a-15009844089f => generated 1756 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:32:38.991410 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-5ed73094-883b-4f9b-a754-85151458a467 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] 10.222.0.30 "GET /compute/v2.1/servers/e5de32bc-4cf2-47cd-b0de-bcc77b9a5791/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.141870 Jun 16 18:32:38.993090 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 250/455] 10.222.0.30 () {58 vars in 1274 bytes} [Thu Jun 16 18:32:38 2022] GET /compute/v2.1/servers/e5de32bc-4cf2-47cd-b0de-bcc77b9a5791/os-interface => generated 284 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 18:32:39.990150 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-878219ce-e9f5-4246-b8d5-ae5dfd97017b tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:32:39.991028 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-878219ce-e9f5-4246-b8d5-ae5dfd97017b tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] [instance: 26fdb428-7e41-4e0f-b91a-15009844089f] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:32:39.999309 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-878219ce-e9f5-4246-b8d5-ae5dfd97017b tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:39.999839 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-878219ce-e9f5-4246-b8d5-ae5dfd97017b tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:40.000926 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-878219ce-e9f5-4246-b8d5-ae5dfd97017b tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:40.001439 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-878219ce-e9f5-4246-b8d5-ae5dfd97017b tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:40.245229 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [req-c80cbb25-1d92-4d98-8324-d180e041a346 req-1194cb97-9d5d-4ce2-ba66-6ca88e8d904f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e5de32bc-4cf2-47cd-b0de-bcc77b9a5791", "tag": "2e698a2a-6a45-4d55-a4e3-1a1a739951af"}]} {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:32:40.261908 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [req-c80cbb25-1d92-4d98-8324-d180e041a346 req-1194cb97-9d5d-4ce2-ba66-6ca88e8d904f service nova] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:40.262709 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [req-c80cbb25-1d92-4d98-8324-d180e041a346 req-1194cb97-9d5d-4ce2-ba66-6ca88e8d904f service nova] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:40.285877 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.compute.server_external_events [req-c80cbb25-1d92-4d98-8324-d180e041a346 req-1194cb97-9d5d-4ce2-ba66-6ca88e8d904f service nova] Creating event network-changed:2e698a2a-6a45-4d55-a4e3-1a1a739951af for instance e5de32bc-4cf2-47cd-b0de-bcc77b9a5791 on hv-cinder-81322 Jun 16 18:32:40.287513 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-878219ce-e9f5-4246-b8d5-ae5dfd97017b tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7d57c4231b49b28a606a17e42267e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9fa2caa1412451aa0308c807d5c62d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:32:40.295733 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [req-c80cbb25-1d92-4d98-8324-d180e041a346 req-1194cb97-9d5d-4ce2-ba66-6ca88e8d904f service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057057 Jun 16 18:32:40.297294 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 251/456] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Jun 16 18:32:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:32:40.298417 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-878219ce-e9f5-4246-b8d5-ae5dfd97017b tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] 10.222.0.30 "GET /compute/v2.1/servers/26fdb428-7e41-4e0f-b91a-15009844089f" status: 200 len: 1756 microversion: 2.1 time: 0.312765 Jun 16 18:32:40.299004 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 206/457] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:32:39 2022] GET /compute/v2.1/servers/26fdb428-7e41-4e0f-b91a-15009844089f => generated 1756 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:32:41.330916 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-7a3011b1-88b0-4efe-b83b-55149f18f582 tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:32:41.332967 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-7a3011b1-88b0-4efe-b83b-55149f18f582 tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] [instance: 26fdb428-7e41-4e0f-b91a-15009844089f] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:32:41.343749 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-7a3011b1-88b0-4efe-b83b-55149f18f582 tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:41.344241 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-7a3011b1-88b0-4efe-b83b-55149f18f582 tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:41.345054 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-7a3011b1-88b0-4efe-b83b-55149f18f582 tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:41.345484 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-7a3011b1-88b0-4efe-b83b-55149f18f582 tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:41.567383 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-7a3011b1-88b0-4efe-b83b-55149f18f582 tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7d57c4231b49b28a606a17e42267e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9fa2caa1412451aa0308c807d5c62d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:32:41.572159 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG dbcounter [-] [117670] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:32:41.581412 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-7a3011b1-88b0-4efe-b83b-55149f18f582 tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] 10.222.0.30 "GET /compute/v2.1/servers/26fdb428-7e41-4e0f-b91a-15009844089f" status: 200 len: 1756 microversion: 2.1 time: 0.258760 Jun 16 18:32:41.582356 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 252/458] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:32:41 2022] GET /compute/v2.1/servers/26fdb428-7e41-4e0f-b91a-15009844089f => generated 1756 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:32:42.610140 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-668a879c-cfa4-484c-a1da-0b6ae9781956 tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:32:42.610140 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-668a879c-cfa4-484c-a1da-0b6ae9781956 tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] [instance: 26fdb428-7e41-4e0f-b91a-15009844089f] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:32:42.618308 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-668a879c-cfa4-484c-a1da-0b6ae9781956 tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:42.618900 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-668a879c-cfa4-484c-a1da-0b6ae9781956 tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:42.619792 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-668a879c-cfa4-484c-a1da-0b6ae9781956 tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:42.620476 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-668a879c-cfa4-484c-a1da-0b6ae9781956 tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:42.798775 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-668a879c-cfa4-484c-a1da-0b6ae9781956 tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7d57c4231b49b28a606a17e42267e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9fa2caa1412451aa0308c807d5c62d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:32:42.808418 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-668a879c-cfa4-484c-a1da-0b6ae9781956 tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] 10.222.0.30 "GET /compute/v2.1/servers/26fdb428-7e41-4e0f-b91a-15009844089f" status: 200 len: 1756 microversion: 2.1 time: 0.204444 Jun 16 18:32:42.809008 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 207/459] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:32:42 2022] GET /compute/v2.1/servers/26fdb428-7e41-4e0f-b91a-15009844089f => generated 1756 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:32:43.827548 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-e2120a3f-abc6-4107-92d6-93b4bb348835 tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:32:43.828199 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-e2120a3f-abc6-4107-92d6-93b4bb348835 tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] [instance: 26fdb428-7e41-4e0f-b91a-15009844089f] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:32:43.836987 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-e2120a3f-abc6-4107-92d6-93b4bb348835 tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:43.837599 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-e2120a3f-abc6-4107-92d6-93b4bb348835 tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:43.838515 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-e2120a3f-abc6-4107-92d6-93b4bb348835 tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:43.839062 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-e2120a3f-abc6-4107-92d6-93b4bb348835 tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:44.017192 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-e2120a3f-abc6-4107-92d6-93b4bb348835 tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7d57c4231b49b28a606a17e42267e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9fa2caa1412451aa0308c807d5c62d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:32:44.029514 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-e2120a3f-abc6-4107-92d6-93b4bb348835 tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] 10.222.0.30 "GET /compute/v2.1/servers/26fdb428-7e41-4e0f-b91a-15009844089f" status: 200 len: 1756 microversion: 2.1 time: 0.206322 Jun 16 18:32:44.030176 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 253/460] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:32:43 2022] GET /compute/v2.1/servers/26fdb428-7e41-4e0f-b91a-15009844089f => generated 1756 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:32:45.048629 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-5aaae7bd-ab75-45c2-be4e-a1d9b2eb1b3e tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:32:45.049504 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-5aaae7bd-ab75-45c2-be4e-a1d9b2eb1b3e tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] [instance: 26fdb428-7e41-4e0f-b91a-15009844089f] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:32:45.056904 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-5aaae7bd-ab75-45c2-be4e-a1d9b2eb1b3e tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:45.057381 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-5aaae7bd-ab75-45c2-be4e-a1d9b2eb1b3e tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:45.058168 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-5aaae7bd-ab75-45c2-be4e-a1d9b2eb1b3e tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:45.058605 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-5aaae7bd-ab75-45c2-be4e-a1d9b2eb1b3e tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:45.238740 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-5aaae7bd-ab75-45c2-be4e-a1d9b2eb1b3e tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7d57c4231b49b28a606a17e42267e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9fa2caa1412451aa0308c807d5c62d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:32:45.252334 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-5aaae7bd-ab75-45c2-be4e-a1d9b2eb1b3e tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] 10.222.0.30 "GET /compute/v2.1/servers/26fdb428-7e41-4e0f-b91a-15009844089f" status: 200 len: 1756 microversion: 2.1 time: 0.207871 Jun 16 18:32:45.253381 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 208/461] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:32:45 2022] GET /compute/v2.1/servers/26fdb428-7e41-4e0f-b91a-15009844089f => generated 1756 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:32:46.271014 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-9a2a69c9-9269-4400-89c3-e2da143b4baf tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:32:46.271714 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-9a2a69c9-9269-4400-89c3-e2da143b4baf tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] [instance: 26fdb428-7e41-4e0f-b91a-15009844089f] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:32:46.281288 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-9a2a69c9-9269-4400-89c3-e2da143b4baf tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:46.282133 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-9a2a69c9-9269-4400-89c3-e2da143b4baf tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:46.283458 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-9a2a69c9-9269-4400-89c3-e2da143b4baf tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:46.284033 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-9a2a69c9-9269-4400-89c3-e2da143b4baf tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:46.459047 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-9a2a69c9-9269-4400-89c3-e2da143b4baf tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7d57c4231b49b28a606a17e42267e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9fa2caa1412451aa0308c807d5c62d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:32:46.471141 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-9a2a69c9-9269-4400-89c3-e2da143b4baf tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] 10.222.0.30 "GET /compute/v2.1/servers/26fdb428-7e41-4e0f-b91a-15009844089f" status: 200 len: 1756 microversion: 2.1 time: 0.204000 Jun 16 18:32:46.471736 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 254/462] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:32:46 2022] GET /compute/v2.1/servers/26fdb428-7e41-4e0f-b91a-15009844089f => generated 1756 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:32:47.493448 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-ddb922a9-3db7-4fbb-a04f-6fea73d6fffc tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:32:47.494142 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-ddb922a9-3db7-4fbb-a04f-6fea73d6fffc tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] [instance: 26fdb428-7e41-4e0f-b91a-15009844089f] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:32:47.501310 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-ddb922a9-3db7-4fbb-a04f-6fea73d6fffc tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:47.501765 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-ddb922a9-3db7-4fbb-a04f-6fea73d6fffc tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:47.502571 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-ddb922a9-3db7-4fbb-a04f-6fea73d6fffc tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:47.503105 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-ddb922a9-3db7-4fbb-a04f-6fea73d6fffc tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:47.724094 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-ddb922a9-3db7-4fbb-a04f-6fea73d6fffc tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7d57c4231b49b28a606a17e42267e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9fa2caa1412451aa0308c807d5c62d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:32:47.738982 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-ddb922a9-3db7-4fbb-a04f-6fea73d6fffc tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] 10.222.0.30 "GET /compute/v2.1/servers/26fdb428-7e41-4e0f-b91a-15009844089f" status: 200 len: 1759 microversion: 2.1 time: 0.249695 Jun 16 18:32:47.740184 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 209/463] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:32:47 2022] GET /compute/v2.1/servers/26fdb428-7e41-4e0f-b91a-15009844089f => generated 1759 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:32:49.902284 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-d7146015-30b4-43c2-8f00-0dd8cbbcf8f9 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "648254df-1f60-4427-b3e6-4d4fcf115c5f"}} {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:32:49.903391 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-d7146015-30b4-43c2-8f00-0dd8cbbcf8f9 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] [instance: e10b3f49-1ff3-474c-833b-b83e3300e617] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:32:49.911445 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-d7146015-30b4-43c2-8f00-0dd8cbbcf8f9 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:49.912077 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-d7146015-30b4-43c2-8f00-0dd8cbbcf8f9 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:49.913404 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-d7146015-30b4-43c2-8f00-0dd8cbbcf8f9 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:49.913567 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-d7146015-30b4-43c2-8f00-0dd8cbbcf8f9 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:50.203275 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-d7146015-30b4-43c2-8f00-0dd8cbbcf8f9 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] 10.222.0.30 "POST /compute/v2.1/servers/e10b3f49-1ff3-474c-833b-b83e3300e617/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.305327 Jun 16 18:32:50.204193 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 255/464] 10.222.0.30 () {60 vars in 1322 bytes} [Thu Jun 16 18:32:49 2022] POST /compute/v2.1/servers/e10b3f49-1ff3-474c-833b-b83e3300e617/os-volume_attachments => generated 194 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 18:32:57.813931 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-e88d65a0-0290-49d9-9019-a594e4692967 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:32:57.815360 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-e88d65a0-0290-49d9-9019-a594e4692967 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] [instance: e10b3f49-1ff3-474c-833b-b83e3300e617] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:32:57.818231 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG dbcounter [-] [117671] Writing DB stats nova_api:SELECT=21 {{(pid=117671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:32:57.818898 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG dbcounter [-] [117671] Writing DB stats nova_cell1:SELECT=82 {{(pid=117671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:32:57.825698 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-e88d65a0-0290-49d9-9019-a594e4692967 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:57.826148 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-e88d65a0-0290-49d9-9019-a594e4692967 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:57.826952 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-e88d65a0-0290-49d9-9019-a594e4692967 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:57.827384 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-e88d65a0-0290-49d9-9019-a594e4692967 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:57.855296 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.objects.instance [None req-e88d65a0-0290-49d9-9019-a594e4692967 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lazy-loading 'flavor' on Instance uuid e10b3f49-1ff3-474c-833b-b83e3300e617 {{(pid=117671) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 18:32:58.008850 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-e88d65a0-0290-49d9-9019-a594e4692967 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] 10.222.0.30 "POST /compute/v2.1/servers/e10b3f49-1ff3-474c-833b-b83e3300e617/action" status: 200 len: 32 microversion: 2.1 time: 0.199186 Jun 16 18:32:58.010059 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 210/465] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Jun 16 18:32:57 2022] POST /compute/v2.1/servers/e10b3f49-1ff3-474c-833b-b83e3300e617/action => generated 32 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 16 18:32:58.025721 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-ad3aedf1-fb2c-4da4-93fb-b0f894c11a0c tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:32:58.027070 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-ad3aedf1-fb2c-4da4-93fb-b0f894c11a0c tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] [instance: e10b3f49-1ff3-474c-833b-b83e3300e617] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:32:58.039073 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-ad3aedf1-fb2c-4da4-93fb-b0f894c11a0c tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:58.039680 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-ad3aedf1-fb2c-4da4-93fb-b0f894c11a0c tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:58.041236 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-ad3aedf1-fb2c-4da4-93fb-b0f894c11a0c tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:58.041785 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-ad3aedf1-fb2c-4da4-93fb-b0f894c11a0c tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:58.267950 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-ad3aedf1-fb2c-4da4-93fb-b0f894c11a0c tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512f01cca14b447c8f6c9eebbd828eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70bbccf07e3404cb94ba59201061a6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:32:58.281531 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-ad3aedf1-fb2c-4da4-93fb-b0f894c11a0c tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] 10.222.0.30 "GET /compute/v2.1/servers/e10b3f49-1ff3-474c-833b-b83e3300e617" status: 200 len: 1736 microversion: 2.1 time: 0.264781 Jun 16 18:32:58.282589 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 256/466] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:32:58 2022] GET /compute/v2.1/servers/e10b3f49-1ff3-474c-833b-b83e3300e617 => generated 1736 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:32:59.314598 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-aaea00bc-37ef-41a3-aa05-95259d25dd21 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:32:59.315861 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-aaea00bc-37ef-41a3-aa05-95259d25dd21 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] [instance: e10b3f49-1ff3-474c-833b-b83e3300e617] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:32:59.328670 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-aaea00bc-37ef-41a3-aa05-95259d25dd21 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:59.329465 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-aaea00bc-37ef-41a3-aa05-95259d25dd21 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:59.330822 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-aaea00bc-37ef-41a3-aa05-95259d25dd21 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:59.331605 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-aaea00bc-37ef-41a3-aa05-95259d25dd21 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:59.497692 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-aaea00bc-37ef-41a3-aa05-95259d25dd21 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512f01cca14b447c8f6c9eebbd828eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70bbccf07e3404cb94ba59201061a6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:32:59.510353 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-aaea00bc-37ef-41a3-aa05-95259d25dd21 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] 10.222.0.30 "GET /compute/v2.1/servers/e10b3f49-1ff3-474c-833b-b83e3300e617" status: 200 len: 1736 microversion: 2.1 time: 0.203733 Jun 16 18:32:59.511524 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 211/467] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:32:59 2022] GET /compute/v2.1/servers/e10b3f49-1ff3-474c-833b-b83e3300e617 => generated 1736 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:32:59.684787 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-fc85c9f4-3e5e-483e-b232-e2d32357662e tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:32:59.685387 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-fc85c9f4-3e5e-483e-b232-e2d32357662e tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] [instance: 651b5fe1-0df7-4bc6-b18e-7caea544a93f] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:32:59.695666 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-fc85c9f4-3e5e-483e-b232-e2d32357662e tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:59.696157 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-fc85c9f4-3e5e-483e-b232-e2d32357662e tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:59.696967 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-fc85c9f4-3e5e-483e-b232-e2d32357662e tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:59.697401 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-fc85c9f4-3e5e-483e-b232-e2d32357662e tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:59.737901 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-fc85c9f4-3e5e-483e-b232-e2d32357662e tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] 10.222.0.30 "GET /compute/v2.1/servers/651b5fe1-0df7-4bc6-b18e-7caea544a93f/os-volume_attachments/ac8d9846-c3c7-4424-bdae-2da3c1c9214a" status: 200 len: 194 microversion: 2.20 time: 0.057328 Jun 16 18:32:59.738544 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 257/468] 10.222.0.30 () {60 vars in 1453 bytes} [Thu Jun 16 18:32:59 2022] GET /compute/v2.1/servers/651b5fe1-0df7-4bc6-b18e-7caea544a93f/os-volume_attachments/ac8d9846-c3c7-4424-bdae-2da3c1c9214a => generated 194 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 18:32:59.815053 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-58722e69-ceec-4276-817d-a3b4c8e4f51f tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:32:59.815598 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-58722e69-ceec-4276-817d-a3b4c8e4f51f tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] [instance: 651b5fe1-0df7-4bc6-b18e-7caea544a93f] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:32:59.822810 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-58722e69-ceec-4276-817d-a3b4c8e4f51f tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:59.823348 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-58722e69-ceec-4276-817d-a3b4c8e4f51f tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:59.824293 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-58722e69-ceec-4276-817d-a3b4c8e4f51f tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:32:59.824833 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-58722e69-ceec-4276-817d-a3b4c8e4f51f tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:32:59.923134 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.objects.instance [None req-58722e69-ceec-4276-817d-a3b4c8e4f51f tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lazy-loading 'services' on Instance uuid 651b5fe1-0df7-4bc6-b18e-7caea544a93f {{(pid=117671) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 18:33:00.017793 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-58722e69-ceec-4276-817d-a3b4c8e4f51f tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] 10.222.0.30 "DELETE /compute/v2.1/servers/651b5fe1-0df7-4bc6-b18e-7caea544a93f/os-volume_attachments/ac8d9846-c3c7-4424-bdae-2da3c1c9214a" status: 202 len: 0 microversion: 2.20 time: 0.206575 Jun 16 18:33:00.018840 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 212/469] 10.222.0.30 () {60 vars in 1456 bytes} [Thu Jun 16 18:32:59 2022] DELETE /compute/v2.1/servers/651b5fe1-0df7-4bc6-b18e-7caea544a93f/os-volume_attachments/ac8d9846-c3c7-4424-bdae-2da3c1c9214a => generated 0 bytes in 209 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jun 16 18:33:00.033013 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-9b726f8a-f74e-416c-9d75-386c1c79e58e tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:33:00.034789 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-9b726f8a-f74e-416c-9d75-386c1c79e58e tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] [instance: 651b5fe1-0df7-4bc6-b18e-7caea544a93f] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:33:00.046032 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-9b726f8a-f74e-416c-9d75-386c1c79e58e tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:00.046547 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-9b726f8a-f74e-416c-9d75-386c1c79e58e tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:00.047749 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-9b726f8a-f74e-416c-9d75-386c1c79e58e tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:00.048304 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-9b726f8a-f74e-416c-9d75-386c1c79e58e tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:00.098730 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-9b726f8a-f74e-416c-9d75-386c1c79e58e tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] 10.222.0.30 "GET /compute/v2.1/servers/651b5fe1-0df7-4bc6-b18e-7caea544a93f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.073029 Jun 16 18:33:00.099786 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 258/470] 10.222.0.30 () {60 vars in 1342 bytes} [Thu Jun 16 18:33:00 2022] GET /compute/v2.1/servers/651b5fe1-0df7-4bc6-b18e-7caea544a93f/os-volume_attachments => generated 197 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 18:33:00.531882 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-b5eb4a19-0d30-4d29-a01a-82c25726ad85 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:33:00.532889 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-b5eb4a19-0d30-4d29-a01a-82c25726ad85 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] [instance: e10b3f49-1ff3-474c-833b-b83e3300e617] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:33:00.540220 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-b5eb4a19-0d30-4d29-a01a-82c25726ad85 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:00.540691 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-b5eb4a19-0d30-4d29-a01a-82c25726ad85 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:00.541493 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-b5eb4a19-0d30-4d29-a01a-82c25726ad85 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:00.541935 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-b5eb4a19-0d30-4d29-a01a-82c25726ad85 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:00.718567 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-b5eb4a19-0d30-4d29-a01a-82c25726ad85 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512f01cca14b447c8f6c9eebbd828eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70bbccf07e3404cb94ba59201061a6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:33:00.735546 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-b5eb4a19-0d30-4d29-a01a-82c25726ad85 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] 10.222.0.30 "GET /compute/v2.1/servers/e10b3f49-1ff3-474c-833b-b83e3300e617" status: 200 len: 1736 microversion: 2.1 time: 0.209124 Jun 16 18:33:00.736714 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 213/471] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:33:00 2022] GET /compute/v2.1/servers/e10b3f49-1ff3-474c-833b-b83e3300e617 => generated 1736 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:33:01.112599 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-de3162fe-08a8-4e43-a1bd-59df89240d5b tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:33:01.113557 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-de3162fe-08a8-4e43-a1bd-59df89240d5b tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] [instance: 651b5fe1-0df7-4bc6-b18e-7caea544a93f] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:33:01.121553 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-de3162fe-08a8-4e43-a1bd-59df89240d5b tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:01.122010 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-de3162fe-08a8-4e43-a1bd-59df89240d5b tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:01.122804 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-de3162fe-08a8-4e43-a1bd-59df89240d5b tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:01.123248 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-de3162fe-08a8-4e43-a1bd-59df89240d5b tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:01.160644 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-de3162fe-08a8-4e43-a1bd-59df89240d5b tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] 10.222.0.30 "GET /compute/v2.1/servers/651b5fe1-0df7-4bc6-b18e-7caea544a93f/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.052346 Jun 16 18:33:01.161142 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 259/472] 10.222.0.30 () {60 vars in 1342 bytes} [Thu Jun 16 18:33:01 2022] GET /compute/v2.1/servers/651b5fe1-0df7-4bc6-b18e-7caea544a93f/os-volume_attachments => generated 25 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:33:01.231106 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-de23a730-dea1-421f-9780-ccf63a351044 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:33:01.231675 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-de23a730-dea1-421f-9780-ccf63a351044 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] [instance: 651b5fe1-0df7-4bc6-b18e-7caea544a93f] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:33:01.238844 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-de23a730-dea1-421f-9780-ccf63a351044 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:01.239369 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-de23a730-dea1-421f-9780-ccf63a351044 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:01.240310 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-de23a730-dea1-421f-9780-ccf63a351044 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:01.240815 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-de23a730-dea1-421f-9780-ccf63a351044 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:01.269977 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-de23a730-dea1-421f-9780-ccf63a351044 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] [instance: 651b5fe1-0df7-4bc6-b18e-7caea544a93f] Going to try to terminate instance {{(pid=117671) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 18:33:01.369304 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-de23a730-dea1-421f-9780-ccf63a351044 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] 10.222.0.30 "DELETE /compute/v2.1/servers/651b5fe1-0df7-4bc6-b18e-7caea544a93f" status: 204 len: 0 microversion: 2.20 time: 0.143648 Jun 16 18:33:01.370222 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 214/473] 10.222.0.30 () {60 vars in 1279 bytes} [Thu Jun 16 18:33:01 2022] DELETE /compute/v2.1/servers/651b5fe1-0df7-4bc6-b18e-7caea544a93f => generated 0 bytes in 146 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 16 18:33:01.379395 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-c6f34a2d-b603-4f54-8ee0-5517ebc7381f tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:33:01.380037 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-c6f34a2d-b603-4f54-8ee0-5517ebc7381f tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] [instance: 651b5fe1-0df7-4bc6-b18e-7caea544a93f] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:33:01.387555 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-c6f34a2d-b603-4f54-8ee0-5517ebc7381f tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:01.388011 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-c6f34a2d-b603-4f54-8ee0-5517ebc7381f tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:01.388841 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-c6f34a2d-b603-4f54-8ee0-5517ebc7381f tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:01.389283 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-c6f34a2d-b603-4f54-8ee0-5517ebc7381f tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:01.572005 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-c6f34a2d-b603-4f54-8ee0-5517ebc7381f tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:33:01.581109 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-c6f34a2d-b603-4f54-8ee0-5517ebc7381f tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:33:01.582736 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-c6f34a2d-b603-4f54-8ee0-5517ebc7381f tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:33:01.584030 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-c6f34a2d-b603-4f54-8ee0-5517ebc7381f tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] 10.222.0.30 "GET /compute/v2.1/servers/651b5fe1-0df7-4bc6-b18e-7caea544a93f" status: 200 len: 1724 microversion: 2.20 time: 0.209272 Jun 16 18:33:01.584706 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 260/474] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Jun 16 18:33:01 2022] GET /compute/v2.1/servers/651b5fe1-0df7-4bc6-b18e-7caea544a93f => generated 1724 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 18:33:01.765514 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-152f62ce-7e46-42c5-a8bf-1128ead3b901 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:33:01.766749 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-152f62ce-7e46-42c5-a8bf-1128ead3b901 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] [instance: e10b3f49-1ff3-474c-833b-b83e3300e617] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:33:01.774177 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-152f62ce-7e46-42c5-a8bf-1128ead3b901 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:01.774632 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-152f62ce-7e46-42c5-a8bf-1128ead3b901 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:01.775430 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-152f62ce-7e46-42c5-a8bf-1128ead3b901 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:01.775874 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-152f62ce-7e46-42c5-a8bf-1128ead3b901 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:01.942379 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-152f62ce-7e46-42c5-a8bf-1128ead3b901 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512f01cca14b447c8f6c9eebbd828eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70bbccf07e3404cb94ba59201061a6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:33:01.951348 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-152f62ce-7e46-42c5-a8bf-1128ead3b901 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] 10.222.0.30 "GET /compute/v2.1/servers/e10b3f49-1ff3-474c-833b-b83e3300e617" status: 200 len: 1736 microversion: 2.1 time: 0.191402 Jun 16 18:33:01.951948 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 215/475] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:33:01 2022] GET /compute/v2.1/servers/e10b3f49-1ff3-474c-833b-b83e3300e617 => generated 1736 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:33:02.605002 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-101fba02-a5fd-4440-ac0f-443865d31908 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:33:02.605832 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-101fba02-a5fd-4440-ac0f-443865d31908 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] [instance: 651b5fe1-0df7-4bc6-b18e-7caea544a93f] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:33:02.614034 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-101fba02-a5fd-4440-ac0f-443865d31908 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:02.614478 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-101fba02-a5fd-4440-ac0f-443865d31908 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:02.615272 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-101fba02-a5fd-4440-ac0f-443865d31908 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:02.615802 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-101fba02-a5fd-4440-ac0f-443865d31908 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:02.792526 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-101fba02-a5fd-4440-ac0f-443865d31908 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:33:02.803102 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-101fba02-a5fd-4440-ac0f-443865d31908 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:33:02.805978 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-101fba02-a5fd-4440-ac0f-443865d31908 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:33:02.807451 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-101fba02-a5fd-4440-ac0f-443865d31908 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] 10.222.0.30 "GET /compute/v2.1/servers/651b5fe1-0df7-4bc6-b18e-7caea544a93f" status: 200 len: 1724 microversion: 2.20 time: 0.206416 Jun 16 18:33:02.808066 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 261/476] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Jun 16 18:33:02 2022] GET /compute/v2.1/servers/651b5fe1-0df7-4bc6-b18e-7caea544a93f => generated 1724 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 18:33:02.969563 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-6a60cc40-7e81-418a-9eb2-1ae727aa264c tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:33:02.970416 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-6a60cc40-7e81-418a-9eb2-1ae727aa264c tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] [instance: e10b3f49-1ff3-474c-833b-b83e3300e617] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:33:02.978292 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-6a60cc40-7e81-418a-9eb2-1ae727aa264c tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:02.978748 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-6a60cc40-7e81-418a-9eb2-1ae727aa264c tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:02.979540 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-6a60cc40-7e81-418a-9eb2-1ae727aa264c tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:02.979980 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-6a60cc40-7e81-418a-9eb2-1ae727aa264c tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:03.159356 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-6a60cc40-7e81-418a-9eb2-1ae727aa264c tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512f01cca14b447c8f6c9eebbd828eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70bbccf07e3404cb94ba59201061a6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:33:03.168631 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-6a60cc40-7e81-418a-9eb2-1ae727aa264c tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] 10.222.0.30 "GET /compute/v2.1/servers/e10b3f49-1ff3-474c-833b-b83e3300e617" status: 200 len: 1736 microversion: 2.1 time: 0.202932 Jun 16 18:33:03.169219 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 216/477] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:33:02 2022] GET /compute/v2.1/servers/e10b3f49-1ff3-474c-833b-b83e3300e617 => generated 1736 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:33:03.830120 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-30885b0f-e570-415b-843d-10334e56be4a tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:33:03.831212 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-30885b0f-e570-415b-843d-10334e56be4a tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] [instance: 651b5fe1-0df7-4bc6-b18e-7caea544a93f] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:33:03.843218 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-30885b0f-e570-415b-843d-10334e56be4a tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:03.843961 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-30885b0f-e570-415b-843d-10334e56be4a tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:03.845369 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-30885b0f-e570-415b-843d-10334e56be4a tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:03.846159 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-30885b0f-e570-415b-843d-10334e56be4a tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:03.949779 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-30885b0f-e570-415b-843d-10334e56be4a tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:33:03.965768 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-30885b0f-e570-415b-843d-10334e56be4a tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:33:03.969761 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-30885b0f-e570-415b-843d-10334e56be4a tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:33:03.973069 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-30885b0f-e570-415b-843d-10334e56be4a tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] 10.222.0.30 "GET /compute/v2.1/servers/651b5fe1-0df7-4bc6-b18e-7caea544a93f" status: 200 len: 1657 microversion: 2.20 time: 0.149426 Jun 16 18:33:03.974073 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 262/478] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Jun 16 18:33:03 2022] GET /compute/v2.1/servers/651b5fe1-0df7-4bc6-b18e-7caea544a93f => generated 1657 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 18:33:04.187380 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-23952152-dec9-4b5b-ba13-f8054f825a19 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:33:04.188685 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-23952152-dec9-4b5b-ba13-f8054f825a19 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] [instance: e10b3f49-1ff3-474c-833b-b83e3300e617] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:33:04.200902 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-23952152-dec9-4b5b-ba13-f8054f825a19 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:04.201721 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-23952152-dec9-4b5b-ba13-f8054f825a19 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:04.203168 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-23952152-dec9-4b5b-ba13-f8054f825a19 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:04.203908 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-23952152-dec9-4b5b-ba13-f8054f825a19 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:04.246788 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [req-87daa6a6-4087-4eca-91a4-83a8d45ac58a req-bae1757e-fb6c-473c-89ba-a38f7295b8cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "651b5fe1-0df7-4bc6-b18e-7caea544a93f", "name": "network-vif-deleted", "tag": "7416c7c3-1e79-4777-a950-c0c27847ca8e"}]} {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:33:04.256365 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [req-87daa6a6-4087-4eca-91a4-83a8d45ac58a req-bae1757e-fb6c-473c-89ba-a38f7295b8cb service nova] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:04.257402 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [req-87daa6a6-4087-4eca-91a4-83a8d45ac58a req-bae1757e-fb6c-473c-89ba-a38f7295b8cb service nova] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:04.270774 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.compute.server_external_events [req-87daa6a6-4087-4eca-91a4-83a8d45ac58a req-bae1757e-fb6c-473c-89ba-a38f7295b8cb service nova] Creating event network-vif-deleted:7416c7c3-1e79-4777-a950-c0c27847ca8e for instance 651b5fe1-0df7-4bc6-b18e-7caea544a93f on hv-cinder-81322 Jun 16 18:33:04.280232 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [req-87daa6a6-4087-4eca-91a4-83a8d45ac58a req-bae1757e-fb6c-473c-89ba-a38f7295b8cb service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042688 Jun 16 18:33:04.280861 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 263/479] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Jun 16 18:33:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 18:33:04.488628 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-23952152-dec9-4b5b-ba13-f8054f825a19 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512f01cca14b447c8f6c9eebbd828eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70bbccf07e3404cb94ba59201061a6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:33:04.500079 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-23952152-dec9-4b5b-ba13-f8054f825a19 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] 10.222.0.30 "GET /compute/v2.1/servers/e10b3f49-1ff3-474c-833b-b83e3300e617" status: 200 len: 1736 microversion: 2.1 time: 0.316943 Jun 16 18:33:04.501506 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 217/480] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:33:04 2022] GET /compute/v2.1/servers/e10b3f49-1ff3-474c-833b-b83e3300e617 => generated 1736 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:33:05.004796 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-f4d04f4e-7024-4f5f-9cb6-c457d4b31554 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:33:05.006051 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-f4d04f4e-7024-4f5f-9cb6-c457d4b31554 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] [instance: 651b5fe1-0df7-4bc6-b18e-7caea544a93f] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:33:05.014523 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-f4d04f4e-7024-4f5f-9cb6-c457d4b31554 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:05.015112 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-f4d04f4e-7024-4f5f-9cb6-c457d4b31554 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:05.016009 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-f4d04f4e-7024-4f5f-9cb6-c457d4b31554 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:05.016614 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-f4d04f4e-7024-4f5f-9cb6-c457d4b31554 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:05.040929 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.wsgi [None req-f4d04f4e-7024-4f5f-9cb6-c457d4b31554 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] HTTP exception thrown: Instance 651b5fe1-0df7-4bc6-b18e-7caea544a93f could not be found. Jun 16 18:33:05.042972 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-f4d04f4e-7024-4f5f-9cb6-c457d4b31554 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Request method failure captured: Jun 16 18:33:05.042972 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: request: GET /compute/v2.1/servers/651b5fe1-0df7-4bc6-b18e-7caea544a93f HTTP/1.1 Jun 16 18:33:05.042972 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: Accept: application/json Jun 16 18:33:05.042972 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: Accept-Encoding: identity Jun 16 18:33:05.042972 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: Connection: close Jun 16 18:33:05.042972 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: Content-Length: 0 Jun 16 18:33:05.042972 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: Content-Type: application/json Jun 16 18:33:05.042972 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: Host: 10.222.0.30 Jun 16 18:33:05.042972 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: Openstack-System-Scope: None Jun 16 18:33:05.042972 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: User-Agent: python-urllib3/1.26.9 Jun 16 18:33:05.042972 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Auth-Token: gAAAAABiq3ZbrtTEFerBg_JHOwUAGoYwgsE2GBTnZhTsj1cdmw0Q4mIQvXU36AW3oVsQBPVOAZ6bsT1Qj0N1aQ8g285FCL3-m_tLJacRbdHgFm_qnK-VV-9b3tCcyoi_LNqFe5D4bDveSC8XKG1FSEvNb7357tShtAEIWMmZv3lUgOlLhoVcpgY Jun 16 18:33:05.042972 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Domain-Id: None Jun 16 18:33:05.042972 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Domain-Name: None Jun 16 18:33:05.042972 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Identity-Status: Confirmed Jun 16 18:33:05.042972 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Is-Admin-Project: True Jun 16 18:33:05.042972 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Openstack-Nova-Api-Version: 2.20 Jun 16 18:33:05.042972 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Project-Domain-Id: default Jun 16 18:33:05.042972 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Project-Domain-Name: Default Jun 16 18:33:05.042972 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Project-Id: 7904e707e39846fdb8b7d019719dc163 Jun 16 18:33:05.042972 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1092341039 Jun 16 18:33:05.042972 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Role: reader,member Jun 16 18:33:05.042972 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Roles: reader,member Jun 16 18:33:05.046040 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/7904e707e39846fdb8b7d019719dc163"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/7904e707e39846fdb8b7d019719dc163"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_7904e707e39846fdb8b7d019719dc163", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/7904e707e39846fdb8b7d019719dc163"}]}] Jun 16 18:33:05.046040 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1092341039 Jun 16 18:33:05.046040 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Tenant-Id: 7904e707e39846fdb8b7d019719dc163 Jun 16 18:33:05.046040 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1092341039 Jun 16 18:33:05.046040 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-User: tempest-AttachVolumeShelveTestJSON-1092341039-project Jun 16 18:33:05.046040 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-User-Domain-Id: default Jun 16 18:33:05.046040 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-User-Domain-Name: Default Jun 16 18:33:05.046040 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-User-Id: 73dc3ab6bc6448a89b26e3e1a1b5c6e8 Jun 16 18:33:05.046040 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1092341039-project Jun 16 18:33:05.046040 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: method: > Jun 16 18:33:05.046040 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: exception: Instance 651b5fe1-0df7-4bc6-b18e-7caea544a93f could not be found. Jun 16 18:33:05.046040 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: action_args: {'id': '651b5fe1-0df7-4bc6-b18e-7caea544a93f'} Jun 16 18:33:05.047416 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:33:05.047416 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:33:05.047416 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 18:33:05.047416 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 18:33:05.047416 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 18:33:05.047416 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 18:33:05.047416 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 18:33:05.047416 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 18:33:05.047416 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 18:33:05.047416 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 18:33:05.047416 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 651b5fe1-0df7-4bc6-b18e-7caea544a93f could not be found. Jun 16 18:33:05.047416 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi Jun 16 18:33:05.047416 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:33:05.047416 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi Jun 16 18:33:05.047416 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:33:05.047416 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:33:05.047416 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:33:05.047416 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:33:05.047416 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:33:05.047416 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:33:05.049584 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:33:05.049584 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 18:33:05.049584 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 18:33:05.049584 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 18:33:05.049584 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 18:33:05.049584 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 18:33:05.049584 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:33:05.049584 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 651b5fe1-0df7-4bc6-b18e-7caea544a93f could not be found. Jun 16 18:33:05.049584 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi Jun 16 18:33:05.049584 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:33:05.049584 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi Jun 16 18:33:05.049584 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:33:05.049584 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:33:05.049584 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:33:05.049584 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:33:05.049584 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:33:05.049584 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 651b5fe1-0df7-4bc6-b18e-7caea544a93f could not be found. Jun 16 18:33:05.049584 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi Jun 16 18:33:05.053065 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-f4d04f4e-7024-4f5f-9cb6-c457d4b31554 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Returning 404 to user: Instance 651b5fe1-0df7-4bc6-b18e-7caea544a93f could not be found. {{(pid=117670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:33:05.053065 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-f4d04f4e-7024-4f5f-9cb6-c457d4b31554 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] 10.222.0.30 "GET /compute/v2.1/servers/651b5fe1-0df7-4bc6-b18e-7caea544a93f" status: 404 len: 111 microversion: 2.20 time: 0.046085 Jun 16 18:33:05.053065 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 264/481] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Jun 16 18:33:04 2022] GET /compute/v2.1/servers/651b5fe1-0df7-4bc6-b18e-7caea544a93f => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jun 16 18:33:05.058079 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-a6ab001c-620d-4148-8909-6bbc653bca10 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Calling method '.version_select at 0x7fbb23db49d0>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:33:05.080755 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-a6ab001c-620d-4148-8909-6bbc653bca10 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1465376425" status: 204 len: 0 microversion: 2.20 time: 0.028753 Jun 16 18:33:05.081916 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 218/482] 10.222.0.30 () {60 vars in 1261 bytes} [Thu Jun 16 18:33:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1465376425 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 16 18:33:05.528842 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-d5294914-72d5-4a74-9988-8c129514360e tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:33:05.529673 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-d5294914-72d5-4a74-9988-8c129514360e tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] [instance: e10b3f49-1ff3-474c-833b-b83e3300e617] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:33:05.538558 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-d5294914-72d5-4a74-9988-8c129514360e tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:05.539595 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-d5294914-72d5-4a74-9988-8c129514360e tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:05.540668 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-d5294914-72d5-4a74-9988-8c129514360e tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:05.541341 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-d5294914-72d5-4a74-9988-8c129514360e tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:05.806944 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-d5294914-72d5-4a74-9988-8c129514360e tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512f01cca14b447c8f6c9eebbd828eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70bbccf07e3404cb94ba59201061a6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:33:05.818485 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-d5294914-72d5-4a74-9988-8c129514360e tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] 10.222.0.30 "GET /compute/v2.1/servers/e10b3f49-1ff3-474c-833b-b83e3300e617" status: 200 len: 1736 microversion: 2.1 time: 0.298397 Jun 16 18:33:05.820076 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 265/483] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:33:05 2022] GET /compute/v2.1/servers/e10b3f49-1ff3-474c-833b-b83e3300e617 => generated 1736 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:33:05.954582 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-c53d52bb-1122-42db-994a-c291aaa19ca5 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Action: 'create', calling method: .version_select at 0x7fbb23e2c820>, body: {"keypair": {"name": "tempest-keypair-873981075", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDIidws/zdpJLGVU5atFR0tiQ/bGU6Xb5HhoqT8ZotL3iiTS9vVyj5d/oEY1z8JEnotjOpRTfTo+y5HW8km+hWElAnd6N3ruYJRhCkM8adoI+ZVB8kobNCTpoV3BqImCQA=="}} {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:33:05.979171 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.quota [None req-c53d52bb-1122-42db-994a-c291aaa19ca5 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Getting quotas for project 7904e707e39846fdb8b7d019719dc163. Resources: {'key_pairs'} {{(pid=117671) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 18:33:05.987063 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.quota [None req-c53d52bb-1122-42db-994a-c291aaa19ca5 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Getting quotas for user 73dc3ab6bc6448a89b26e3e1a1b5c6e8 and project 7904e707e39846fdb8b7d019719dc163. Resources: {'key_pairs'} {{(pid=117671) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 18:33:06.022361 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-c53d52bb-1122-42db-994a-c291aaa19ca5 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.073004 Jun 16 18:33:06.023023 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 219/484] 10.222.0.30 () {62 vars in 1199 bytes} [Thu Jun 16 18:33:05 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 75 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jun 16 18:33:06.841311 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-38c6f590-5b46-470c-8725-88af38ac58c5 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:33:06.842356 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-38c6f590-5b46-470c-8725-88af38ac58c5 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] [instance: e10b3f49-1ff3-474c-833b-b83e3300e617] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:33:06.845454 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG dbcounter [-] [117670] Writing DB stats nova_api:SELECT=38 {{(pid=117670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:33:06.853574 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-38c6f590-5b46-470c-8725-88af38ac58c5 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:06.854203 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-38c6f590-5b46-470c-8725-88af38ac58c5 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:06.855224 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-38c6f590-5b46-470c-8725-88af38ac58c5 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:06.855804 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-38c6f590-5b46-470c-8725-88af38ac58c5 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:07.079708 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-38c6f590-5b46-470c-8725-88af38ac58c5 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512f01cca14b447c8f6c9eebbd828eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70bbccf07e3404cb94ba59201061a6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:33:07.089896 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-38c6f590-5b46-470c-8725-88af38ac58c5 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] 10.222.0.30 "GET /compute/v2.1/servers/e10b3f49-1ff3-474c-833b-b83e3300e617" status: 200 len: 1736 microversion: 2.1 time: 0.252983 Jun 16 18:33:07.104452 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 266/485] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:33:06 2022] GET /compute/v2.1/servers/e10b3f49-1ff3-474c-833b-b83e3300e617 => generated 1736 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:33:07.599049 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-9e40bffb-f5ac-400a-a0f1-cfb432a1ab6f tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-979576005", "imageRef": "38ef083a-a9ff-4836-8954-f770268ba205", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "cdfdfccf-e3dc-489b-8eaf-0509b174579d"}], "security_groups": [{"name": "tempest-securitygroup--421577703"}], "key_name": "tempest-keypair-873981075", "user_data": "}} {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:33:07.724862 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.network.neutron [None req-9e40bffb-f5ac-400a-a0f1-cfb432a1ab6f tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] validate_networks() for [('cdfdfccf-e3dc-489b-8eaf-0509b174579d', None, None, None, None, None)] {{(pid=117671) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 18:33:08.119696 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-62440a04-531a-43e3-ba2f-bb8425a07862 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:33:08.120496 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-62440a04-531a-43e3-ba2f-bb8425a07862 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] [instance: e10b3f49-1ff3-474c-833b-b83e3300e617] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:33:08.127969 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-62440a04-531a-43e3-ba2f-bb8425a07862 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:08.128489 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-62440a04-531a-43e3-ba2f-bb8425a07862 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:08.129230 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-62440a04-531a-43e3-ba2f-bb8425a07862 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:08.130085 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-62440a04-531a-43e3-ba2f-bb8425a07862 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:08.163136 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.virt.hardware [None req-9e40bffb-f5ac-400a-a0f1-cfb432a1ab6f tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Flavor limits 0:0:0 {{(pid=117671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 18:33:08.163668 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.virt.hardware [None req-9e40bffb-f5ac-400a-a0f1-cfb432a1ab6f tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Image limits 0:0:0 {{(pid=117671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 18:33:08.164179 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.virt.hardware [None req-9e40bffb-f5ac-400a-a0f1-cfb432a1ab6f tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Flavor pref 0:0:0 {{(pid=117671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 18:33:08.164593 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.virt.hardware [None req-9e40bffb-f5ac-400a-a0f1-cfb432a1ab6f tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Image pref 0:0:0 {{(pid=117671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 18:33:08.165004 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.virt.hardware [None req-9e40bffb-f5ac-400a-a0f1-cfb432a1ab6f tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 18:33:08.175987 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-9e40bffb-f5ac-400a-a0f1-cfb432a1ab6f tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:08.176482 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-9e40bffb-f5ac-400a-a0f1-cfb432a1ab6f tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:08.177269 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-9e40bffb-f5ac-400a-a0f1-cfb432a1ab6f tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:08.177709 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-9e40bffb-f5ac-400a-a0f1-cfb432a1ab6f tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:08.198410 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.quota [None req-9e40bffb-f5ac-400a-a0f1-cfb432a1ab6f tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Getting quotas for project 7904e707e39846fdb8b7d019719dc163. Resources: {'instances', 'ram', 'cores'} {{(pid=117671) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 18:33:08.204332 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.quota [None req-9e40bffb-f5ac-400a-a0f1-cfb432a1ab6f tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Getting quotas for user 73dc3ab6bc6448a89b26e3e1a1b5c6e8 and project 7904e707e39846fdb8b7d019719dc163. Resources: {'instances', 'ram', 'cores'} {{(pid=117671) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 18:33:08.217143 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-9e40bffb-f5ac-400a-a0f1-cfb432a1ab6f tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Going to run 1 instances... {{(pid=117671) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 18:33:08.219626 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-9e40bffb-f5ac-400a-a0f1-cfb432a1ab6f tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] [instance: 16226ccb-8bc4-43b6-abd5-7601be0e57b5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='38ef083a-a9ff-4836-8954-f770268ba205',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117671) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 18:33:08.289526 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-9e40bffb-f5ac-400a-a0f1-cfb432a1ab6f tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.696654 Jun 16 18:33:08.290557 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 220/486] 10.222.0.30 () {62 vars in 1187 bytes} [Thu Jun 16 18:33:07 2022] POST /compute/v2.1/servers => generated 401 bytes in 698 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 16 18:33:08.305638 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-4f31f03d-bf8e-4575-a057-7ded3b9cce52 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:33:08.305638 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-4f31f03d-bf8e-4575-a057-7ded3b9cce52 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] [instance: 16226ccb-8bc4-43b6-abd5-7601be0e57b5] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:33:08.320924 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-62440a04-531a-43e3-ba2f-bb8425a07862 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512f01cca14b447c8f6c9eebbd828eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70bbccf07e3404cb94ba59201061a6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:33:08.341322 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-62440a04-531a-43e3-ba2f-bb8425a07862 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] 10.222.0.30 "GET /compute/v2.1/servers/e10b3f49-1ff3-474c-833b-b83e3300e617" status: 200 len: 1736 microversion: 2.1 time: 0.227283 Jun 16 18:33:08.342482 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 267/487] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:33:08 2022] GET /compute/v2.1/servers/e10b3f49-1ff3-474c-833b-b83e3300e617 => generated 1736 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:33:08.379790 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-4f31f03d-bf8e-4575-a057-7ded3b9cce52 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:33:08.390193 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-4f31f03d-bf8e-4575-a057-7ded3b9cce52 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:33:08.392127 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-4f31f03d-bf8e-4575-a057-7ded3b9cce52 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:33:08.393402 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-4f31f03d-bf8e-4575-a057-7ded3b9cce52 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] 10.222.0.30 "GET /compute/v2.1/servers/16226ccb-8bc4-43b6-abd5-7601be0e57b5" status: 200 len: 1280 microversion: 2.20 time: 0.092961 Jun 16 18:33:08.394048 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 221/488] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Jun 16 18:33:08 2022] GET /compute/v2.1/servers/16226ccb-8bc4-43b6-abd5-7601be0e57b5 => generated 1280 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:33:09.361205 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-61d0f881-19d0-4d20-ad51-ea7cc7f1c091 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:33:09.362090 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-61d0f881-19d0-4d20-ad51-ea7cc7f1c091 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] [instance: e10b3f49-1ff3-474c-833b-b83e3300e617] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:33:09.369485 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-61d0f881-19d0-4d20-ad51-ea7cc7f1c091 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:09.369939 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-61d0f881-19d0-4d20-ad51-ea7cc7f1c091 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:09.370727 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-61d0f881-19d0-4d20-ad51-ea7cc7f1c091 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:09.371169 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-61d0f881-19d0-4d20-ad51-ea7cc7f1c091 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:09.414081 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-ec0f5dda-fe85-418e-99f2-afd1769c4c1e tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:33:09.414695 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-ec0f5dda-fe85-418e-99f2-afd1769c4c1e tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] [instance: 16226ccb-8bc4-43b6-abd5-7601be0e57b5] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:33:09.422746 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-ec0f5dda-fe85-418e-99f2-afd1769c4c1e tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:09.423196 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-ec0f5dda-fe85-418e-99f2-afd1769c4c1e tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:09.423982 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-ec0f5dda-fe85-418e-99f2-afd1769c4c1e tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:09.424458 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-ec0f5dda-fe85-418e-99f2-afd1769c4c1e tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:09.527713 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-ec0f5dda-fe85-418e-99f2-afd1769c4c1e tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:33:09.537207 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-ec0f5dda-fe85-418e-99f2-afd1769c4c1e tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:33:09.539242 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-ec0f5dda-fe85-418e-99f2-afd1769c4c1e tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:33:09.540430 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-ec0f5dda-fe85-418e-99f2-afd1769c4c1e tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] 10.222.0.30 "GET /compute/v2.1/servers/16226ccb-8bc4-43b6-abd5-7601be0e57b5" status: 200 len: 1332 microversion: 2.20 time: 0.130697 Jun 16 18:33:09.541002 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 222/489] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Jun 16 18:33:09 2022] GET /compute/v2.1/servers/16226ccb-8bc4-43b6-abd5-7601be0e57b5 => generated 1332 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:33:09.580805 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-61d0f881-19d0-4d20-ad51-ea7cc7f1c091 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512f01cca14b447c8f6c9eebbd828eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70bbccf07e3404cb94ba59201061a6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:33:09.596273 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-61d0f881-19d0-4d20-ad51-ea7cc7f1c091 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] 10.222.0.30 "GET /compute/v2.1/servers/e10b3f49-1ff3-474c-833b-b83e3300e617" status: 200 len: 1736 microversion: 2.1 time: 0.238809 Jun 16 18:33:09.597357 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 268/490] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:33:09 2022] GET /compute/v2.1/servers/e10b3f49-1ff3-474c-833b-b83e3300e617 => generated 1736 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:33:10.574362 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-a8c5d905-d80a-4f3a-bdf7-b1cfe25277cb tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:33:10.575974 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-a8c5d905-d80a-4f3a-bdf7-b1cfe25277cb tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] [instance: 16226ccb-8bc4-43b6-abd5-7601be0e57b5] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:33:10.591073 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-a8c5d905-d80a-4f3a-bdf7-b1cfe25277cb tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:10.592411 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-a8c5d905-d80a-4f3a-bdf7-b1cfe25277cb tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:10.594318 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-a8c5d905-d80a-4f3a-bdf7-b1cfe25277cb tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:10.595429 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-a8c5d905-d80a-4f3a-bdf7-b1cfe25277cb tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:10.626172 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-85713929-e079-4f61-8dbf-8025990441dd tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:33:10.627291 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-85713929-e079-4f61-8dbf-8025990441dd tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] [instance: e10b3f49-1ff3-474c-833b-b83e3300e617] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:33:10.637218 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-85713929-e079-4f61-8dbf-8025990441dd tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:10.637860 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-85713929-e079-4f61-8dbf-8025990441dd tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:10.638811 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-85713929-e079-4f61-8dbf-8025990441dd tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:10.639603 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-85713929-e079-4f61-8dbf-8025990441dd tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:10.659434 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG dbcounter [-] [117670] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:33:10.778093 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-a8c5d905-d80a-4f3a-bdf7-b1cfe25277cb tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:33:10.788576 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-a8c5d905-d80a-4f3a-bdf7-b1cfe25277cb tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:33:10.796808 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-a8c5d905-d80a-4f3a-bdf7-b1cfe25277cb tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:33:10.798310 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-a8c5d905-d80a-4f3a-bdf7-b1cfe25277cb tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] 10.222.0.30 "GET /compute/v2.1/servers/16226ccb-8bc4-43b6-abd5-7601be0e57b5" status: 200 len: 1350 microversion: 2.20 time: 0.232811 Jun 16 18:33:10.799416 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 223/491] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Jun 16 18:33:10 2022] GET /compute/v2.1/servers/16226ccb-8bc4-43b6-abd5-7601be0e57b5 => generated 1350 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:33:10.911782 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-85713929-e079-4f61-8dbf-8025990441dd tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512f01cca14b447c8f6c9eebbd828eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70bbccf07e3404cb94ba59201061a6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:33:10.928489 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-85713929-e079-4f61-8dbf-8025990441dd tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] 10.222.0.30 "GET /compute/v2.1/servers/e10b3f49-1ff3-474c-833b-b83e3300e617" status: 200 len: 1736 microversion: 2.1 time: 0.306586 Jun 16 18:33:10.929570 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 269/492] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:33:10 2022] GET /compute/v2.1/servers/e10b3f49-1ff3-474c-833b-b83e3300e617 => generated 1736 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:33:11.820728 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-2d123555-1065-4914-9cea-92d06ac4827f tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:33:11.821620 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-2d123555-1065-4914-9cea-92d06ac4827f tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] [instance: 16226ccb-8bc4-43b6-abd5-7601be0e57b5] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:33:11.832601 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-2d123555-1065-4914-9cea-92d06ac4827f tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:11.833438 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-2d123555-1065-4914-9cea-92d06ac4827f tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:11.835356 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-2d123555-1065-4914-9cea-92d06ac4827f tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:11.836459 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-2d123555-1065-4914-9cea-92d06ac4827f tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:11.961368 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-2b23798b-1c17-4eda-9d15-231d549eda40 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:33:11.962377 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-2b23798b-1c17-4eda-9d15-231d549eda40 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] [instance: e10b3f49-1ff3-474c-833b-b83e3300e617] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:33:11.975132 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-2b23798b-1c17-4eda-9d15-231d549eda40 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:11.976471 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-2b23798b-1c17-4eda-9d15-231d549eda40 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:11.977936 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-2b23798b-1c17-4eda-9d15-231d549eda40 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:11.978684 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-2b23798b-1c17-4eda-9d15-231d549eda40 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:12.115711 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-2d123555-1065-4914-9cea-92d06ac4827f tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:33:12.138615 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-2d123555-1065-4914-9cea-92d06ac4827f tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:33:12.144515 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-2d123555-1065-4914-9cea-92d06ac4827f tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:33:12.153963 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-2d123555-1065-4914-9cea-92d06ac4827f tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] 10.222.0.30 "GET /compute/v2.1/servers/16226ccb-8bc4-43b6-abd5-7601be0e57b5" status: 200 len: 1405 microversion: 2.20 time: 0.332360 Jun 16 18:33:12.155559 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 224/493] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Jun 16 18:33:11 2022] GET /compute/v2.1/servers/16226ccb-8bc4-43b6-abd5-7601be0e57b5 => generated 1405 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 18:33:12.230932 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-2b23798b-1c17-4eda-9d15-231d549eda40 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512f01cca14b447c8f6c9eebbd828eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70bbccf07e3404cb94ba59201061a6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:33:12.253719 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-2b23798b-1c17-4eda-9d15-231d549eda40 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] 10.222.0.30 "GET /compute/v2.1/servers/e10b3f49-1ff3-474c-833b-b83e3300e617" status: 200 len: 1736 microversion: 2.1 time: 0.299946 Jun 16 18:33:12.255109 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 270/494] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:33:11 2022] GET /compute/v2.1/servers/e10b3f49-1ff3-474c-833b-b83e3300e617 => generated 1736 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:33:12.419079 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [req-eaf36aea-0df0-4e73-be40-64db43a1e610 req-dac468e1-39ff-4e63-89a0-deecc7ea4d77 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "16226ccb-8bc4-43b6-abd5-7601be0e57b5", "tag": "fc74ff6c-f681-43e5-ba34-42732de13dac"}]} {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:33:12.440005 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [req-eaf36aea-0df0-4e73-be40-64db43a1e610 req-dac468e1-39ff-4e63-89a0-deecc7ea4d77 service nova] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:12.441765 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [req-eaf36aea-0df0-4e73-be40-64db43a1e610 req-dac468e1-39ff-4e63-89a0-deecc7ea4d77 service nova] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:12.473843 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.compute.server_external_events [req-eaf36aea-0df0-4e73-be40-64db43a1e610 req-dac468e1-39ff-4e63-89a0-deecc7ea4d77 service nova] Creating event network-changed:fc74ff6c-f681-43e5-ba34-42732de13dac for instance 16226ccb-8bc4-43b6-abd5-7601be0e57b5 on hv-cinder-81322 Jun 16 18:33:12.482525 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [req-eaf36aea-0df0-4e73-be40-64db43a1e610 req-dac468e1-39ff-4e63-89a0-deecc7ea4d77 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067370 Jun 16 18:33:12.483523 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 225/495] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Jun 16 18:33:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 18:33:13.182834 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-fb9710c3-fe3f-4ab0-91e1-37748a2680ce tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:33:13.183623 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-fb9710c3-fe3f-4ab0-91e1-37748a2680ce tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] [instance: 16226ccb-8bc4-43b6-abd5-7601be0e57b5] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:33:13.192207 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-fb9710c3-fe3f-4ab0-91e1-37748a2680ce tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:13.192658 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-fb9710c3-fe3f-4ab0-91e1-37748a2680ce tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:13.193487 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-fb9710c3-fe3f-4ab0-91e1-37748a2680ce tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:13.194168 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-fb9710c3-fe3f-4ab0-91e1-37748a2680ce tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:13.276970 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-2bfb9f8d-339f-4631-b201-abdc101219b7 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:33:13.278711 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-2bfb9f8d-339f-4631-b201-abdc101219b7 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] [instance: e10b3f49-1ff3-474c-833b-b83e3300e617] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:33:13.287780 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-2bfb9f8d-339f-4631-b201-abdc101219b7 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:13.289057 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-2bfb9f8d-339f-4631-b201-abdc101219b7 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:13.290200 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-2bfb9f8d-339f-4631-b201-abdc101219b7 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:13.290919 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-2bfb9f8d-339f-4631-b201-abdc101219b7 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:13.321034 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG dbcounter [-] [117671] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=117671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:33:13.423519 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-fb9710c3-fe3f-4ab0-91e1-37748a2680ce tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:33:13.434531 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-fb9710c3-fe3f-4ab0-91e1-37748a2680ce tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:33:13.435993 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-fb9710c3-fe3f-4ab0-91e1-37748a2680ce tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:33:13.437191 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-fb9710c3-fe3f-4ab0-91e1-37748a2680ce tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] 10.222.0.30 "GET /compute/v2.1/servers/16226ccb-8bc4-43b6-abd5-7601be0e57b5" status: 200 len: 1405 microversion: 2.20 time: 0.258619 Jun 16 18:33:13.437761 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 271/496] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Jun 16 18:33:13 2022] GET /compute/v2.1/servers/16226ccb-8bc4-43b6-abd5-7601be0e57b5 => generated 1405 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:33:13.544156 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-2bfb9f8d-339f-4631-b201-abdc101219b7 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512f01cca14b447c8f6c9eebbd828eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70bbccf07e3404cb94ba59201061a6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:33:13.566519 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-2bfb9f8d-339f-4631-b201-abdc101219b7 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] 10.222.0.30 "GET /compute/v2.1/servers/e10b3f49-1ff3-474c-833b-b83e3300e617" status: 200 len: 1716 microversion: 2.1 time: 0.296142 Jun 16 18:33:13.567793 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 226/497] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:33:13 2022] GET /compute/v2.1/servers/e10b3f49-1ff3-474c-833b-b83e3300e617 => generated 1716 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:33:13.722090 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-d1d48136-4cfe-4194-a8f4-2297fa94c39f tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:33:13.722662 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-d1d48136-4cfe-4194-a8f4-2297fa94c39f tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] [instance: e10b3f49-1ff3-474c-833b-b83e3300e617] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:33:13.729918 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-d1d48136-4cfe-4194-a8f4-2297fa94c39f tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:13.730361 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-d1d48136-4cfe-4194-a8f4-2297fa94c39f tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:13.731149 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-d1d48136-4cfe-4194-a8f4-2297fa94c39f tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:13.731583 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-d1d48136-4cfe-4194-a8f4-2297fa94c39f tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:13.892767 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.wsgi [None req-d1d48136-4cfe-4194-a8f4-2297fa94c39f tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] HTTP exception thrown: Cannot 'detach_volume' instance e10b3f49-1ff3-474c-833b-b83e3300e617 while it is in vm_state rescued Jun 16 18:33:13.894451 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-d1d48136-4cfe-4194-a8f4-2297fa94c39f tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Request method failure captured: Jun 16 18:33:13.894451 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: request: DELETE /compute/v2.1/servers/e10b3f49-1ff3-474c-833b-b83e3300e617/os-volume_attachments/648254df-1f60-4427-b3e6-4d4fcf115c5f HTTP/1.1 Jun 16 18:33:13.894451 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: Accept: application/json Jun 16 18:33:13.894451 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: Accept-Encoding: identity Jun 16 18:33:13.894451 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: Connection: close Jun 16 18:33:13.894451 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: Content-Length: 0 Jun 16 18:33:13.894451 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: Content-Type: application/json Jun 16 18:33:13.894451 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: Host: 10.222.0.30 Jun 16 18:33:13.894451 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: Openstack-System-Scope: None Jun 16 18:33:13.894451 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: User-Agent: python-urllib3/1.26.9 Jun 16 18:33:13.894451 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Auth-Token: gAAAAABiq3ZeOWVXrcHoFQenWS7gEz2AmLT0pk9WALQKP9rY-D8or65AIFivXjSOMGuT5nkfTCPX-UgC2J78DfMkn6N1K-iY82TmKX61g47gNVuWG9jlnvzIzdHnPvexbz1CwR9za6ZIAFnBpf6Y_L3GTnzg7Lzmn3ZLTYDBiHKMrCwhKJPoGQI Jun 16 18:33:13.894451 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Domain-Id: None Jun 16 18:33:13.894451 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Domain-Name: None Jun 16 18:33:13.894451 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Identity-Status: Confirmed Jun 16 18:33:13.894451 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Is-Admin-Project: True Jun 16 18:33:13.894451 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Project-Domain-Id: default Jun 16 18:33:13.894451 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Project-Domain-Name: Default Jun 16 18:33:13.894451 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Project-Id: b70bbccf07e3404cb94ba59201061a6a Jun 16 18:33:13.894451 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1891572618 Jun 16 18:33:13.894451 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Role: reader,member Jun 16 18:33:13.894451 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Roles: reader,member Jun 16 18:33:13.896556 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/b70bbccf07e3404cb94ba59201061a6a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/b70bbccf07e3404cb94ba59201061a6a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_b70bbccf07e3404cb94ba59201061a6a", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/b70bbccf07e3404cb94ba59201061a6a"}]}] Jun 16 18:33:13.896556 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1891572618 Jun 16 18:33:13.896556 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Tenant-Id: b70bbccf07e3404cb94ba59201061a6a Jun 16 18:33:13.896556 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1891572618 Jun 16 18:33:13.896556 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-User: tempest-ServerRescueNegativeTestJSON-1891572618-project Jun 16 18:33:13.896556 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-User-Domain-Id: default Jun 16 18:33:13.896556 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-User-Domain-Name: Default Jun 16 18:33:13.896556 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-User-Id: 512f01cca14b447c8f6c9eebbd828eb2 Jun 16 18:33:13.896556 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1891572618-project Jun 16 18:33:13.896556 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: method: > Jun 16 18:33:13.896556 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: exception: Cannot 'detach_volume' instance e10b3f49-1ff3-474c-833b-b83e3300e617 while it is in vm_state rescued Jun 16 18:33:13.903072 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: action_args: {'server_id': 'e10b3f49-1ff3-474c-833b-b83e3300e617', 'id': '648254df-1f60-4427-b3e6-4d4fcf115c5f'} Jun 16 18:33:13.903072 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:33:13.903072 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:33:13.903072 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jun 16 18:33:13.903072 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jun 16 18:33:13.903072 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 16 18:33:13.903072 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 16 18:33:13.903072 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 16 18:33:13.903072 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 16 18:33:13.903072 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance e10b3f49-1ff3-474c-833b-b83e3300e617 in vm_state rescued. Cannot detach_volume while the instance is in this state. Jun 16 18:33:13.903072 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi Jun 16 18:33:13.903072 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:33:13.903072 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi Jun 16 18:33:13.903072 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:33:13.903072 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:33:13.903072 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:33:13.903072 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:33:13.903072 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:33:13.903072 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:33:13.903072 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:33:13.905631 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jun 16 18:33:13.905631 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 16 18:33:13.905631 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 16 18:33:13.905631 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 16 18:33:13.905631 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance e10b3f49-1ff3-474c-833b-b83e3300e617 while it is in vm_state rescued Jun 16 18:33:13.905631 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi Jun 16 18:33:13.905631 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:33:13.905631 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi Jun 16 18:33:13.905631 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:33:13.905631 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:33:13.905631 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:33:13.905631 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:33:13.905631 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:33:13.905631 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance e10b3f49-1ff3-474c-833b-b83e3300e617 while it is in vm_state rescued Jun 16 18:33:13.905631 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi Jun 16 18:33:13.905631 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-d1d48136-4cfe-4194-a8f4-2297fa94c39f tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Returning 409 to user: Cannot 'detach_volume' instance e10b3f49-1ff3-474c-833b-b83e3300e617 while it is in vm_state rescued {{(pid=117670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:33:13.907520 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-d1d48136-4cfe-4194-a8f4-2297fa94c39f tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] 10.222.0.30 "DELETE /compute/v2.1/servers/e10b3f49-1ff3-474c-833b-b83e3300e617/os-volume_attachments/648254df-1f60-4427-b3e6-4d4fcf115c5f" status: 409 len: 152 microversion: 2.1 time: 0.178333 Jun 16 18:33:13.907520 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 272/498] 10.222.0.30 () {58 vars in 1415 bytes} [Thu Jun 16 18:33:13 2022] DELETE /compute/v2.1/servers/e10b3f49-1ff3-474c-833b-b83e3300e617/os-volume_attachments/648254df-1f60-4427-b3e6-4d4fcf115c5f => generated 152 bytes in 180 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Jun 16 18:33:13.910812 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-db1f9790-43ad-4d12-ac52-7e6b17ac6f09 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:33:13.911382 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-db1f9790-43ad-4d12-ac52-7e6b17ac6f09 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] [instance: e10b3f49-1ff3-474c-833b-b83e3300e617] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:33:13.921085 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-db1f9790-43ad-4d12-ac52-7e6b17ac6f09 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:13.921785 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-db1f9790-43ad-4d12-ac52-7e6b17ac6f09 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:13.923258 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-db1f9790-43ad-4d12-ac52-7e6b17ac6f09 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:13.924135 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-db1f9790-43ad-4d12-ac52-7e6b17ac6f09 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:14.012228 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-db1f9790-43ad-4d12-ac52-7e6b17ac6f09 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] 10.222.0.30 "POST /compute/v2.1/servers/e10b3f49-1ff3-474c-833b-b83e3300e617/action" status: 202 len: 0 microversion: 2.1 time: 0.107552 Jun 16 18:33:14.012784 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 227/499] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Jun 16 18:33:13 2022] POST /compute/v2.1/servers/e10b3f49-1ff3-474c-833b-b83e3300e617/action => generated 0 bytes in 110 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 18:33:14.021697 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-402ebd1f-044c-40b7-bac7-520e9684ecf6 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:33:14.023032 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-402ebd1f-044c-40b7-bac7-520e9684ecf6 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] [instance: e10b3f49-1ff3-474c-833b-b83e3300e617] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:33:14.030603 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-402ebd1f-044c-40b7-bac7-520e9684ecf6 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:14.031068 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-402ebd1f-044c-40b7-bac7-520e9684ecf6 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:14.032358 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-402ebd1f-044c-40b7-bac7-520e9684ecf6 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:14.032912 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-402ebd1f-044c-40b7-bac7-520e9684ecf6 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:14.221581 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-402ebd1f-044c-40b7-bac7-520e9684ecf6 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512f01cca14b447c8f6c9eebbd828eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70bbccf07e3404cb94ba59201061a6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:33:14.231713 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-402ebd1f-044c-40b7-bac7-520e9684ecf6 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] 10.222.0.30 "GET /compute/v2.1/servers/e10b3f49-1ff3-474c-833b-b83e3300e617" status: 200 len: 1724 microversion: 2.1 time: 0.214221 Jun 16 18:33:14.232592 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 273/500] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:33:14 2022] GET /compute/v2.1/servers/e10b3f49-1ff3-474c-833b-b83e3300e617 => generated 1724 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:33:14.459826 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-e0d433ca-0761-49f4-a17b-1005626c8638 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:33:14.460622 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-e0d433ca-0761-49f4-a17b-1005626c8638 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] [instance: 16226ccb-8bc4-43b6-abd5-7601be0e57b5] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:33:14.467516 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-e0d433ca-0761-49f4-a17b-1005626c8638 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:14.467971 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-e0d433ca-0761-49f4-a17b-1005626c8638 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:14.468857 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-e0d433ca-0761-49f4-a17b-1005626c8638 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:14.469263 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-e0d433ca-0761-49f4-a17b-1005626c8638 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:14.652693 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-e0d433ca-0761-49f4-a17b-1005626c8638 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:33:14.665635 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-e0d433ca-0761-49f4-a17b-1005626c8638 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:33:14.668360 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-e0d433ca-0761-49f4-a17b-1005626c8638 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:33:14.669881 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-e0d433ca-0761-49f4-a17b-1005626c8638 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] 10.222.0.30 "GET /compute/v2.1/servers/16226ccb-8bc4-43b6-abd5-7601be0e57b5" status: 200 len: 1405 microversion: 2.20 time: 0.215154 Jun 16 18:33:14.670484 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 228/501] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Jun 16 18:33:14 2022] GET /compute/v2.1/servers/16226ccb-8bc4-43b6-abd5-7601be0e57b5 => generated 1405 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 18:33:15.256619 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-da063af6-b17a-42d7-b7ea-069275dfdafe tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:33:15.257928 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-da063af6-b17a-42d7-b7ea-069275dfdafe tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] [instance: e10b3f49-1ff3-474c-833b-b83e3300e617] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:33:15.270804 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-da063af6-b17a-42d7-b7ea-069275dfdafe tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:15.271631 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-da063af6-b17a-42d7-b7ea-069275dfdafe tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:15.273701 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-da063af6-b17a-42d7-b7ea-069275dfdafe tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:15.274521 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-da063af6-b17a-42d7-b7ea-069275dfdafe tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:15.691132 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-5fa10ff2-9a5d-4acd-959c-c6d01bbc0de0 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:33:15.692022 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-5fa10ff2-9a5d-4acd-959c-c6d01bbc0de0 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] [instance: 16226ccb-8bc4-43b6-abd5-7601be0e57b5] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:33:15.700506 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-5fa10ff2-9a5d-4acd-959c-c6d01bbc0de0 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:15.700985 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-5fa10ff2-9a5d-4acd-959c-c6d01bbc0de0 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:15.702050 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-5fa10ff2-9a5d-4acd-959c-c6d01bbc0de0 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:15.702501 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-5fa10ff2-9a5d-4acd-959c-c6d01bbc0de0 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:15.929294 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-da063af6-b17a-42d7-b7ea-069275dfdafe tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512f01cca14b447c8f6c9eebbd828eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70bbccf07e3404cb94ba59201061a6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:33:15.946456 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-da063af6-b17a-42d7-b7ea-069275dfdafe tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] 10.222.0.30 "GET /compute/v2.1/servers/e10b3f49-1ff3-474c-833b-b83e3300e617" status: 200 len: 1724 microversion: 2.1 time: 0.697109 Jun 16 18:33:15.955877 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-5fa10ff2-9a5d-4acd-959c-c6d01bbc0de0 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:33:15.967251 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 274/502] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:33:15 2022] GET /compute/v2.1/servers/e10b3f49-1ff3-474c-833b-b83e3300e617 => generated 1724 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:33:15.977430 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-5fa10ff2-9a5d-4acd-959c-c6d01bbc0de0 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:33:15.981232 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-5fa10ff2-9a5d-4acd-959c-c6d01bbc0de0 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:33:15.983972 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-5fa10ff2-9a5d-4acd-959c-c6d01bbc0de0 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] 10.222.0.30 "GET /compute/v2.1/servers/16226ccb-8bc4-43b6-abd5-7601be0e57b5" status: 200 len: 1405 microversion: 2.20 time: 0.296501 Jun 16 18:33:15.985381 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 229/503] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Jun 16 18:33:15 2022] GET /compute/v2.1/servers/16226ccb-8bc4-43b6-abd5-7601be0e57b5 => generated 1405 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 18:33:16.974597 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-34532a62-c5bc-4880-9f11-691d020ee285 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:33:16.975484 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-34532a62-c5bc-4880-9f11-691d020ee285 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] [instance: e10b3f49-1ff3-474c-833b-b83e3300e617] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:33:16.982531 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-34532a62-c5bc-4880-9f11-691d020ee285 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:16.982975 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-34532a62-c5bc-4880-9f11-691d020ee285 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:16.983876 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-34532a62-c5bc-4880-9f11-691d020ee285 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:16.984386 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-34532a62-c5bc-4880-9f11-691d020ee285 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:17.007820 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-dee0b57a-5e54-4044-8589-ae044cc3fc2e tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:33:17.009004 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-dee0b57a-5e54-4044-8589-ae044cc3fc2e tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] [instance: 16226ccb-8bc4-43b6-abd5-7601be0e57b5] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:33:17.017331 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-dee0b57a-5e54-4044-8589-ae044cc3fc2e tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:17.017942 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-dee0b57a-5e54-4044-8589-ae044cc3fc2e tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:17.018929 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-dee0b57a-5e54-4044-8589-ae044cc3fc2e tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:17.019448 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-dee0b57a-5e54-4044-8589-ae044cc3fc2e tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:17.180035 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-34532a62-c5bc-4880-9f11-691d020ee285 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512f01cca14b447c8f6c9eebbd828eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70bbccf07e3404cb94ba59201061a6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:33:17.189228 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-34532a62-c5bc-4880-9f11-691d020ee285 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] 10.222.0.30 "GET /compute/v2.1/servers/e10b3f49-1ff3-474c-833b-b83e3300e617" status: 200 len: 1724 microversion: 2.1 time: 0.218650 Jun 16 18:33:17.190224 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 275/504] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:33:16 2022] GET /compute/v2.1/servers/e10b3f49-1ff3-474c-833b-b83e3300e617 => generated 1724 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:33:17.234590 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-dee0b57a-5e54-4044-8589-ae044cc3fc2e tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:33:17.244745 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-dee0b57a-5e54-4044-8589-ae044cc3fc2e tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:33:17.246370 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-dee0b57a-5e54-4044-8589-ae044cc3fc2e tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:33:17.247717 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-dee0b57a-5e54-4044-8589-ae044cc3fc2e tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] 10.222.0.30 "GET /compute/v2.1/servers/16226ccb-8bc4-43b6-abd5-7601be0e57b5" status: 200 len: 1405 microversion: 2.20 time: 0.245403 Jun 16 18:33:17.248418 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 230/505] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Jun 16 18:33:17 2022] GET /compute/v2.1/servers/16226ccb-8bc4-43b6-abd5-7601be0e57b5 => generated 1405 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 18:33:18.210332 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-aca37175-2f4b-47ab-b31b-b6dd05a1ccdd tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:33:18.211437 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-aca37175-2f4b-47ab-b31b-b6dd05a1ccdd tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] [instance: e10b3f49-1ff3-474c-833b-b83e3300e617] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:33:18.219066 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-aca37175-2f4b-47ab-b31b-b6dd05a1ccdd tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:18.219517 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-aca37175-2f4b-47ab-b31b-b6dd05a1ccdd tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:18.220348 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-aca37175-2f4b-47ab-b31b-b6dd05a1ccdd tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:18.220824 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-aca37175-2f4b-47ab-b31b-b6dd05a1ccdd tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:18.278812 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-9a4b39b4-e059-4df4-b0de-4cb37d91afcd tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:33:18.280195 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-9a4b39b4-e059-4df4-b0de-4cb37d91afcd tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] [instance: 16226ccb-8bc4-43b6-abd5-7601be0e57b5] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:33:18.287023 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG dbcounter [-] [117671] Writing DB stats nova_cell0:SELECT=2 {{(pid=117671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:33:18.296783 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-9a4b39b4-e059-4df4-b0de-4cb37d91afcd tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:18.297581 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-9a4b39b4-e059-4df4-b0de-4cb37d91afcd tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:18.298972 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-9a4b39b4-e059-4df4-b0de-4cb37d91afcd tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:18.300164 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-9a4b39b4-e059-4df4-b0de-4cb37d91afcd tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:18.385765 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG dbcounter [-] [117671] Writing DB stats nova_cell0:SELECT=12 {{(pid=117671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:33:18.424257 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-aca37175-2f4b-47ab-b31b-b6dd05a1ccdd tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512f01cca14b447c8f6c9eebbd828eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70bbccf07e3404cb94ba59201061a6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:33:18.436124 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-aca37175-2f4b-47ab-b31b-b6dd05a1ccdd tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] 10.222.0.30 "GET /compute/v2.1/servers/e10b3f49-1ff3-474c-833b-b83e3300e617" status: 200 len: 1724 microversion: 2.1 time: 0.231505 Jun 16 18:33:18.436732 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 276/506] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:33:18 2022] GET /compute/v2.1/servers/e10b3f49-1ff3-474c-833b-b83e3300e617 => generated 1724 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:33:18.528142 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-9a4b39b4-e059-4df4-b0de-4cb37d91afcd tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:33:18.543220 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-9a4b39b4-e059-4df4-b0de-4cb37d91afcd tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:33:18.545135 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-9a4b39b4-e059-4df4-b0de-4cb37d91afcd tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:33:18.546891 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-9a4b39b4-e059-4df4-b0de-4cb37d91afcd tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] 10.222.0.30 "GET /compute/v2.1/servers/16226ccb-8bc4-43b6-abd5-7601be0e57b5" status: 200 len: 1405 microversion: 2.20 time: 0.275761 Jun 16 18:33:18.547646 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 231/507] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Jun 16 18:33:18 2022] GET /compute/v2.1/servers/16226ccb-8bc4-43b6-abd5-7601be0e57b5 => generated 1405 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:33:18.875542 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [req-b7e18145-ccaf-4733-bcef-b97599ff71f5 req-f6662053-b4bd-4aa7-adb5-9183cbc32f9a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16226ccb-8bc4-43b6-abd5-7601be0e57b5", "name": "network-vif-plugged", "status": "completed", "tag": "fc74ff6c-f681-43e5-ba34-42732de13dac"}]} {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:33:18.885412 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [req-b7e18145-ccaf-4733-bcef-b97599ff71f5 req-f6662053-b4bd-4aa7-adb5-9183cbc32f9a service nova] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:18.885859 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [req-b7e18145-ccaf-4733-bcef-b97599ff71f5 req-f6662053-b4bd-4aa7-adb5-9183cbc32f9a service nova] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:18.903466 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.compute.server_external_events [req-b7e18145-ccaf-4733-bcef-b97599ff71f5 req-f6662053-b4bd-4aa7-adb5-9183cbc32f9a service nova] Creating event network-vif-plugged:fc74ff6c-f681-43e5-ba34-42732de13dac for instance 16226ccb-8bc4-43b6-abd5-7601be0e57b5 on hv-cinder-81322 Jun 16 18:33:18.911462 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [req-b7e18145-ccaf-4733-bcef-b97599ff71f5 req-f6662053-b4bd-4aa7-adb5-9183cbc32f9a service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039805 Jun 16 18:33:18.912371 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 277/508] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Jun 16 18:33:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:33:19.454572 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-879fed14-f974-4309-b9dd-c0e9f048016c tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:33:19.455247 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-879fed14-f974-4309-b9dd-c0e9f048016c tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] [instance: e10b3f49-1ff3-474c-833b-b83e3300e617] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:33:19.463137 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-879fed14-f974-4309-b9dd-c0e9f048016c tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:19.463596 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-879fed14-f974-4309-b9dd-c0e9f048016c tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:19.464428 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-879fed14-f974-4309-b9dd-c0e9f048016c tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:19.464871 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-879fed14-f974-4309-b9dd-c0e9f048016c tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:19.568727 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-33571bda-3761-49ed-b16a-f9ffc9eb3a33 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:33:19.570082 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-33571bda-3761-49ed-b16a-f9ffc9eb3a33 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] [instance: 16226ccb-8bc4-43b6-abd5-7601be0e57b5] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:33:19.577018 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-33571bda-3761-49ed-b16a-f9ffc9eb3a33 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:19.577439 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-33571bda-3761-49ed-b16a-f9ffc9eb3a33 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:19.578214 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-33571bda-3761-49ed-b16a-f9ffc9eb3a33 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:19.578777 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-33571bda-3761-49ed-b16a-f9ffc9eb3a33 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:19.627655 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-879fed14-f974-4309-b9dd-c0e9f048016c tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512f01cca14b447c8f6c9eebbd828eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70bbccf07e3404cb94ba59201061a6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:33:19.641590 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-879fed14-f974-4309-b9dd-c0e9f048016c tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] 10.222.0.30 "GET /compute/v2.1/servers/e10b3f49-1ff3-474c-833b-b83e3300e617" status: 200 len: 1730 microversion: 2.1 time: 0.190682 Jun 16 18:33:19.642773 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 232/509] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:33:19 2022] GET /compute/v2.1/servers/e10b3f49-1ff3-474c-833b-b83e3300e617 => generated 1730 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:33:19.672940 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-b4327572-a4fe-4f39-9738-8ba4c551ec1d tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:33:19.673450 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-b4327572-a4fe-4f39-9738-8ba4c551ec1d tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] [instance: e10b3f49-1ff3-474c-833b-b83e3300e617] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:33:19.680590 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-b4327572-a4fe-4f39-9738-8ba4c551ec1d tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:19.681048 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-b4327572-a4fe-4f39-9738-8ba4c551ec1d tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:19.681860 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-b4327572-a4fe-4f39-9738-8ba4c551ec1d tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:19.682302 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-b4327572-a4fe-4f39-9738-8ba4c551ec1d tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:19.776270 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-33571bda-3761-49ed-b16a-f9ffc9eb3a33 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:33:19.790612 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-33571bda-3761-49ed-b16a-f9ffc9eb3a33 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:33:19.792898 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-b4327572-a4fe-4f39-9738-8ba4c551ec1d tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] 10.222.0.30 "GET /compute/v2.1/servers/e10b3f49-1ff3-474c-833b-b83e3300e617/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.124106 Jun 16 18:33:19.793790 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 233/510] 10.222.0.30 () {58 vars in 1274 bytes} [Thu Jun 16 18:33:19 2022] GET /compute/v2.1/servers/e10b3f49-1ff3-474c-833b-b83e3300e617/os-interface => generated 285 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:33:19.793949 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-33571bda-3761-49ed-b16a-f9ffc9eb3a33 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:33:19.796406 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-33571bda-3761-49ed-b16a-f9ffc9eb3a33 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] 10.222.0.30 "GET /compute/v2.1/servers/16226ccb-8bc4-43b6-abd5-7601be0e57b5" status: 200 len: 1405 microversion: 2.20 time: 0.231902 Jun 16 18:33:19.797436 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 278/511] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Jun 16 18:33:19 2022] GET /compute/v2.1/servers/16226ccb-8bc4-43b6-abd5-7601be0e57b5 => generated 1405 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 18:33:20.824379 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-ed41f4f2-d1ca-45b5-b287-9f5d1d4b7e98 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:33:20.825803 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-ed41f4f2-d1ca-45b5-b287-9f5d1d4b7e98 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] [instance: 16226ccb-8bc4-43b6-abd5-7601be0e57b5] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:33:20.839201 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-ed41f4f2-d1ca-45b5-b287-9f5d1d4b7e98 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:20.840110 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-ed41f4f2-d1ca-45b5-b287-9f5d1d4b7e98 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:20.841560 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-ed41f4f2-d1ca-45b5-b287-9f5d1d4b7e98 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:20.842391 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-ed41f4f2-d1ca-45b5-b287-9f5d1d4b7e98 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:20.876431 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [req-6765b522-73cd-43d9-b8d3-8f5b366e8053 req-738fa154-b796-4b4f-9ffa-2f67c8a5fe11 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e10b3f49-1ff3-474c-833b-b83e3300e617", "tag": "415b1820-aec4-49ee-8ec3-7e34692c9dc5"}]} {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:33:20.898902 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [req-6765b522-73cd-43d9-b8d3-8f5b366e8053 req-738fa154-b796-4b4f-9ffa-2f67c8a5fe11 service nova] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:20.898902 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [req-6765b522-73cd-43d9-b8d3-8f5b366e8053 req-738fa154-b796-4b4f-9ffa-2f67c8a5fe11 service nova] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:20.914962 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.compute.server_external_events [req-6765b522-73cd-43d9-b8d3-8f5b366e8053 req-738fa154-b796-4b4f-9ffa-2f67c8a5fe11 service nova] Creating event network-changed:415b1820-aec4-49ee-8ec3-7e34692c9dc5 for instance e10b3f49-1ff3-474c-833b-b83e3300e617 on hv-cinder-81322 Jun 16 18:33:20.922297 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [req-6765b522-73cd-43d9-b8d3-8f5b366e8053 req-738fa154-b796-4b4f-9ffa-2f67c8a5fe11 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049255 Jun 16 18:33:20.923172 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 279/512] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Jun 16 18:33:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:33:21.105605 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-ed41f4f2-d1ca-45b5-b287-9f5d1d4b7e98 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:33:21.114943 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-ed41f4f2-d1ca-45b5-b287-9f5d1d4b7e98 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:33:21.117555 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-ed41f4f2-d1ca-45b5-b287-9f5d1d4b7e98 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:33:21.119409 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-ed41f4f2-d1ca-45b5-b287-9f5d1d4b7e98 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] 10.222.0.30 "GET /compute/v2.1/servers/16226ccb-8bc4-43b6-abd5-7601be0e57b5" status: 200 len: 1405 microversion: 2.20 time: 0.307029 Jun 16 18:33:21.120811 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 234/513] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Jun 16 18:33:20 2022] GET /compute/v2.1/servers/16226ccb-8bc4-43b6-abd5-7601be0e57b5 => generated 1405 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:33:22.155223 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-55c928fb-1918-4b23-aca3-62aee9638701 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:33:22.156530 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-55c928fb-1918-4b23-aca3-62aee9638701 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] [instance: 16226ccb-8bc4-43b6-abd5-7601be0e57b5] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:33:22.171783 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-55c928fb-1918-4b23-aca3-62aee9638701 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:22.172554 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-55c928fb-1918-4b23-aca3-62aee9638701 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:22.173831 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-55c928fb-1918-4b23-aca3-62aee9638701 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:22.174630 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-55c928fb-1918-4b23-aca3-62aee9638701 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:22.379510 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-55c928fb-1918-4b23-aca3-62aee9638701 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:33:22.389383 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-55c928fb-1918-4b23-aca3-62aee9638701 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:33:22.390855 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-55c928fb-1918-4b23-aca3-62aee9638701 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:33:22.392146 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-55c928fb-1918-4b23-aca3-62aee9638701 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] 10.222.0.30 "GET /compute/v2.1/servers/16226ccb-8bc4-43b6-abd5-7601be0e57b5" status: 200 len: 1596 microversion: 2.20 time: 0.246927 Jun 16 18:33:22.392718 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 280/514] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Jun 16 18:33:22 2022] GET /compute/v2.1/servers/16226ccb-8bc4-43b6-abd5-7601be0e57b5 => generated 1596 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:33:22.411920 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-78b93396-4bb4-4b78-8195-aca56eb155a8 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:33:22.413137 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-78b93396-4bb4-4b78-8195-aca56eb155a8 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] [instance: 16226ccb-8bc4-43b6-abd5-7601be0e57b5] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:33:22.419826 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-78b93396-4bb4-4b78-8195-aca56eb155a8 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:22.420539 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-78b93396-4bb4-4b78-8195-aca56eb155a8 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:22.421717 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-78b93396-4bb4-4b78-8195-aca56eb155a8 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:22.422217 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-78b93396-4bb4-4b78-8195-aca56eb155a8 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:22.549892 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-78b93396-4bb4-4b78-8195-aca56eb155a8 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] 10.222.0.30 "GET /compute/v2.1/servers/16226ccb-8bc4-43b6-abd5-7601be0e57b5/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.142274 Jun 16 18:33:22.550618 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 235/515] 10.222.0.30 () {60 vars in 1315 bytes} [Thu Jun 16 18:33:22 2022] GET /compute/v2.1/servers/16226ccb-8bc4-43b6-abd5-7601be0e57b5/os-interface => generated 284 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 18:33:22.969142 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [req-990c7a65-60d3-4885-8672-89723b3a26d1 req-d2a035d3-b25e-40fb-b9e3-20328f51729c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e10b3f49-1ff3-474c-833b-b83e3300e617", "tag": "415b1820-aec4-49ee-8ec3-7e34692c9dc5"}]} {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:33:22.979430 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [req-990c7a65-60d3-4885-8672-89723b3a26d1 req-d2a035d3-b25e-40fb-b9e3-20328f51729c service nova] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:22.979883 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [req-990c7a65-60d3-4885-8672-89723b3a26d1 req-d2a035d3-b25e-40fb-b9e3-20328f51729c service nova] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:22.992868 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.compute.server_external_events [req-990c7a65-60d3-4885-8672-89723b3a26d1 req-d2a035d3-b25e-40fb-b9e3-20328f51729c service nova] Creating event network-changed:415b1820-aec4-49ee-8ec3-7e34692c9dc5 for instance e10b3f49-1ff3-474c-833b-b83e3300e617 on hv-cinder-81322 Jun 16 18:33:22.998550 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [req-990c7a65-60d3-4885-8672-89723b3a26d1 req-d2a035d3-b25e-40fb-b9e3-20328f51729c service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033246 Jun 16 18:33:22.999379 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 281/516] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Jun 16 18:33:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 18:33:24.154630 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-71e0f12d-ef00-497d-9b94-3268e3c11afc tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:33:24.155368 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-71e0f12d-ef00-497d-9b94-3268e3c11afc tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] [instance: e5de32bc-4cf2-47cd-b0de-bcc77b9a5791] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:33:24.162323 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-71e0f12d-ef00-497d-9b94-3268e3c11afc tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:24.162777 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-71e0f12d-ef00-497d-9b94-3268e3c11afc tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:24.163583 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-71e0f12d-ef00-497d-9b94-3268e3c11afc tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:24.164021 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-71e0f12d-ef00-497d-9b94-3268e3c11afc tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:24.192728 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-71e0f12d-ef00-497d-9b94-3268e3c11afc tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] 10.222.0.30 "GET /compute/v2.1/servers/e5de32bc-4cf2-47cd-b0de-bcc77b9a5791/ips" status: 200 len: 148 microversion: 2.1 time: 0.042426 Jun 16 18:33:24.193736 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 236/517] 10.222.0.30 () {58 vars in 1247 bytes} [Thu Jun 16 18:33:24 2022] GET /compute/v2.1/servers/e5de32bc-4cf2-47cd-b0de-bcc77b9a5791/ips => generated 148 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:33:25.075401 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [req-1ef5dc06-2dcc-499c-94e4-15e7a8066aee req-9cc93cac-e995-4623-9b1d-060c688156b7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "16226ccb-8bc4-43b6-abd5-7601be0e57b5", "tag": "fc74ff6c-f681-43e5-ba34-42732de13dac"}]} {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:33:25.088349 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [req-1ef5dc06-2dcc-499c-94e4-15e7a8066aee req-9cc93cac-e995-4623-9b1d-060c688156b7 service nova] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:25.089084 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [req-1ef5dc06-2dcc-499c-94e4-15e7a8066aee req-9cc93cac-e995-4623-9b1d-060c688156b7 service nova] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:25.104540 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.compute.server_external_events [req-1ef5dc06-2dcc-499c-94e4-15e7a8066aee req-9cc93cac-e995-4623-9b1d-060c688156b7 service nova] Creating event network-changed:fc74ff6c-f681-43e5-ba34-42732de13dac for instance 16226ccb-8bc4-43b6-abd5-7601be0e57b5 on hv-cinder-81322 Jun 16 18:33:25.110649 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [req-1ef5dc06-2dcc-499c-94e4-15e7a8066aee req-9cc93cac-e995-4623-9b1d-060c688156b7 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042414 Jun 16 18:33:25.111598 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 282/518] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Jun 16 18:33:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 18:33:25.694684 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-e2996d61-c3d0-47b8-9ebb-8dff2a78a7b0 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "95145fa9-8719-422d-8b3b-587cf2e2f758"}} {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:33:25.696888 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-e2996d61-c3d0-47b8-9ebb-8dff2a78a7b0 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] [instance: e5de32bc-4cf2-47cd-b0de-bcc77b9a5791] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:33:25.710138 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-e2996d61-c3d0-47b8-9ebb-8dff2a78a7b0 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:25.710976 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-e2996d61-c3d0-47b8-9ebb-8dff2a78a7b0 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:25.712541 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-e2996d61-c3d0-47b8-9ebb-8dff2a78a7b0 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:25.713535 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-e2996d61-c3d0-47b8-9ebb-8dff2a78a7b0 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:26.386909 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-e2996d61-c3d0-47b8-9ebb-8dff2a78a7b0 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] 10.222.0.30 "POST /compute/v2.1/servers/e5de32bc-4cf2-47cd-b0de-bcc77b9a5791/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.701457 Jun 16 18:33:26.387801 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 237/519] 10.222.0.30 () {60 vars in 1322 bytes} [Thu Jun 16 18:33:25 2022] POST /compute/v2.1/servers/e5de32bc-4cf2-47cd-b0de-bcc77b9a5791/os-volume_attachments => generated 194 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:33:29.193079 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-e57f3279-e06a-49c4-90ad-533668823947 tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-860295531"}} {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:33:29.194358 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-e57f3279-e06a-49c4-90ad-533668823947 tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] [instance: 26fdb428-7e41-4e0f-b91a-15009844089f] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:33:29.201306 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-e57f3279-e06a-49c4-90ad-533668823947 tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:29.201812 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-e57f3279-e06a-49c4-90ad-533668823947 tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:29.202644 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-e57f3279-e06a-49c4-90ad-533668823947 tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:29.203126 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-e57f3279-e06a-49c4-90ad-533668823947 tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:29.500858 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.network.security_group_api [None req-e57f3279-e06a-49c4-90ad-533668823947 tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Removing security group 464748d0-cf04-46b0-b8e3-bfb3833aaaa2 from port 60aa1d76-6fda-4493-91ab-da6bd2ca0a42 Jun 16 18:33:29.929792 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-e57f3279-e06a-49c4-90ad-533668823947 tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] 10.222.0.30 "POST /compute/v2.1/servers/26fdb428-7e41-4e0f-b91a-15009844089f/action" status: 202 len: 0 microversion: 2.1 time: 0.740366 Jun 16 18:33:29.930698 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 283/520] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Jun 16 18:33:29 2022] POST /compute/v2.1/servers/26fdb428-7e41-4e0f-b91a-15009844089f/action => generated 0 bytes in 744 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 16 18:33:29.938508 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [req-d7664875-a0c2-4298-8b44-07076c456fb8 req-600d647c-d357-47a5-8a76-11d05c0355ca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "26fdb428-7e41-4e0f-b91a-15009844089f", "tag": "60aa1d76-6fda-4493-91ab-da6bd2ca0a42"}]} {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:33:29.948373 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG dbcounter [-] [117671] Writing DB stats nova_api:SELECT=87,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=117671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:33:29.950909 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [req-d7664875-a0c2-4298-8b44-07076c456fb8 req-600d647c-d357-47a5-8a76-11d05c0355ca service nova] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:29.951431 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [req-d7664875-a0c2-4298-8b44-07076c456fb8 req-600d647c-d357-47a5-8a76-11d05c0355ca service nova] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:29.990724 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.compute.server_external_events [req-d7664875-a0c2-4298-8b44-07076c456fb8 req-600d647c-d357-47a5-8a76-11d05c0355ca service nova] Creating event network-changed:60aa1d76-6fda-4493-91ab-da6bd2ca0a42 for instance 26fdb428-7e41-4e0f-b91a-15009844089f on hv-cinder-81322 Jun 16 18:33:30.000371 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [req-d7664875-a0c2-4298-8b44-07076c456fb8 req-600d647c-d357-47a5-8a76-11d05c0355ca service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066599 Jun 16 18:33:30.001647 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 238/521] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Jun 16 18:33:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:33:31.377080 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-46766511-768d-4480-afcf-e34c9f1704bc tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:33:31.377932 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-46766511-768d-4480-afcf-e34c9f1704bc tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] [instance: 26fdb428-7e41-4e0f-b91a-15009844089f] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:33:31.380373 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [req-3a2e5639-113b-4d3c-a5e2-4d049ca4c145 req-8ea477fe-4631-448a-95f8-0d3029bd93f7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "26fdb428-7e41-4e0f-b91a-15009844089f", "tag": "60aa1d76-6fda-4493-91ab-da6bd2ca0a42"}]} {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:33:31.390391 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-46766511-768d-4480-afcf-e34c9f1704bc tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:31.391040 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-46766511-768d-4480-afcf-e34c9f1704bc tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:31.392449 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-46766511-768d-4480-afcf-e34c9f1704bc tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:31.393195 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-46766511-768d-4480-afcf-e34c9f1704bc tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:31.401387 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [req-3a2e5639-113b-4d3c-a5e2-4d049ca4c145 req-8ea477fe-4631-448a-95f8-0d3029bd93f7 service nova] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:31.402235 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [req-3a2e5639-113b-4d3c-a5e2-4d049ca4c145 req-8ea477fe-4631-448a-95f8-0d3029bd93f7 service nova] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:31.431435 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.compute.server_external_events [req-3a2e5639-113b-4d3c-a5e2-4d049ca4c145 req-8ea477fe-4631-448a-95f8-0d3029bd93f7 service nova] Creating event network-changed:60aa1d76-6fda-4493-91ab-da6bd2ca0a42 for instance 26fdb428-7e41-4e0f-b91a-15009844089f on hv-cinder-81322 Jun 16 18:33:31.440338 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [req-3a2e5639-113b-4d3c-a5e2-4d049ca4c145 req-8ea477fe-4631-448a-95f8-0d3029bd93f7 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067489 Jun 16 18:33:31.441902 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 239/522] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Jun 16 18:33:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 18:33:31.557246 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.objects.instance [None req-46766511-768d-4480-afcf-e34c9f1704bc tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Lazy-loading 'services' on Instance uuid 26fdb428-7e41-4e0f-b91a-15009844089f {{(pid=117670) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 18:33:31.713636 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-46766511-768d-4480-afcf-e34c9f1704bc tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] 10.222.0.30 "DELETE /compute/v2.1/servers/26fdb428-7e41-4e0f-b91a-15009844089f/os-volume_attachments/622a80ea-7379-4123-84e6-95a50efb3b40" status: 202 len: 0 microversion: 2.1 time: 0.343335 Jun 16 18:33:31.714530 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 284/523] 10.222.0.30 () {58 vars in 1415 bytes} [Thu Jun 16 18:33:31 2022] DELETE /compute/v2.1/servers/26fdb428-7e41-4e0f-b91a-15009844089f/os-volume_attachments/622a80ea-7379-4123-84e6-95a50efb3b40 => generated 0 bytes in 346 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 16 18:33:31.725577 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-103ec53d-db66-4efb-a82f-e411d1abb924 tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:33:31.726847 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-103ec53d-db66-4efb-a82f-e411d1abb924 tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] [instance: 26fdb428-7e41-4e0f-b91a-15009844089f] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:33:31.736146 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-103ec53d-db66-4efb-a82f-e411d1abb924 tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:31.736912 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-103ec53d-db66-4efb-a82f-e411d1abb924 tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:31.737670 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-103ec53d-db66-4efb-a82f-e411d1abb924 tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:31.738102 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-103ec53d-db66-4efb-a82f-e411d1abb924 tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:31.786966 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-103ec53d-db66-4efb-a82f-e411d1abb924 tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] 10.222.0.30 "GET /compute/v2.1/servers/26fdb428-7e41-4e0f-b91a-15009844089f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.067252 Jun 16 18:33:31.788494 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 240/524] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Jun 16 18:33:31 2022] GET /compute/v2.1/servers/26fdb428-7e41-4e0f-b91a-15009844089f/os-volume_attachments => generated 197 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 18:33:32.802273 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-f910cc7e-b1a1-4802-8231-92c75a620ed0 tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:33:32.804866 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-f910cc7e-b1a1-4802-8231-92c75a620ed0 tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] [instance: 26fdb428-7e41-4e0f-b91a-15009844089f] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:33:32.814103 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-f910cc7e-b1a1-4802-8231-92c75a620ed0 tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:32.814698 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-f910cc7e-b1a1-4802-8231-92c75a620ed0 tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:32.815919 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-f910cc7e-b1a1-4802-8231-92c75a620ed0 tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:32.816457 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-f910cc7e-b1a1-4802-8231-92c75a620ed0 tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:32.861735 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-f910cc7e-b1a1-4802-8231-92c75a620ed0 tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] 10.222.0.30 "GET /compute/v2.1/servers/26fdb428-7e41-4e0f-b91a-15009844089f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.065379 Jun 16 18:33:32.862818 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 285/525] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Jun 16 18:33:32 2022] GET /compute/v2.1/servers/26fdb428-7e41-4e0f-b91a-15009844089f/os-volume_attachments => generated 197 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 18:33:33.879416 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-c4d96d52-142f-4428-be6a-195d517d28a8 tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:33:33.880422 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-c4d96d52-142f-4428-be6a-195d517d28a8 tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] [instance: 26fdb428-7e41-4e0f-b91a-15009844089f] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:33:33.887759 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-c4d96d52-142f-4428-be6a-195d517d28a8 tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:33.888280 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-c4d96d52-142f-4428-be6a-195d517d28a8 tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:33.889100 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-c4d96d52-142f-4428-be6a-195d517d28a8 tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:33.889807 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-c4d96d52-142f-4428-be6a-195d517d28a8 tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:33.931833 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-c4d96d52-142f-4428-be6a-195d517d28a8 tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] 10.222.0.30 "GET /compute/v2.1/servers/26fdb428-7e41-4e0f-b91a-15009844089f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.057491 Jun 16 18:33:33.932461 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 241/526] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Jun 16 18:33:33 2022] GET /compute/v2.1/servers/26fdb428-7e41-4e0f-b91a-15009844089f/os-volume_attachments => generated 25 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 16 18:33:33.943363 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-3cb387e6-b9c2-45bd-9f0d-6cc3a0e0609d tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:33:33.944702 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-3cb387e6-b9c2-45bd-9f0d-6cc3a0e0609d tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] [instance: 26fdb428-7e41-4e0f-b91a-15009844089f] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:33:33.952890 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-3cb387e6-b9c2-45bd-9f0d-6cc3a0e0609d tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:33.953342 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-3cb387e6-b9c2-45bd-9f0d-6cc3a0e0609d tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:33.954134 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-3cb387e6-b9c2-45bd-9f0d-6cc3a0e0609d tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:33.954573 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-3cb387e6-b9c2-45bd-9f0d-6cc3a0e0609d tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:34.066755 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.wsgi [None req-3cb387e6-b9c2-45bd-9f0d-6cc3a0e0609d tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] HTTP exception thrown: Instance 26fdb428-7e41-4e0f-b91a-15009844089f is not attached to volume 622a80ea-7379-4123-84e6-95a50efb3b40 Jun 16 18:33:34.072613 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-3cb387e6-b9c2-45bd-9f0d-6cc3a0e0609d tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Request method failure captured: Jun 16 18:33:34.072613 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: request: DELETE /compute/v2.1/servers/26fdb428-7e41-4e0f-b91a-15009844089f/os-volume_attachments/622a80ea-7379-4123-84e6-95a50efb3b40 HTTP/1.1 Jun 16 18:33:34.072613 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: Accept: application/json Jun 16 18:33:34.072613 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: Accept-Encoding: identity Jun 16 18:33:34.072613 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: Connection: close Jun 16 18:33:34.072613 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: Content-Length: 0 Jun 16 18:33:34.072613 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: Content-Type: application/json Jun 16 18:33:34.072613 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: Host: 10.222.0.30 Jun 16 18:33:34.072613 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: Openstack-System-Scope: None Jun 16 18:33:34.072613 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: User-Agent: python-urllib3/1.26.9 Jun 16 18:33:34.072613 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Auth-Token: gAAAAABiq3a-soRipyqPTEjwIOFTpkhmWuBEjRzmocqjH0s5N8R-uVIrVdFDyIhP-6nzIYUJBVsBgI8fIT1FHudSYxDg2BS76vyy_Hm6o9-q7EFEHTE0y_mwWnDKLgfhWOZBw5IbAWut9ZO6UqKTawZvvqkdyyLGR1oQEH9AKTeV-n590oTDEZ8 Jun 16 18:33:34.072613 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Domain-Id: None Jun 16 18:33:34.072613 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Domain-Name: None Jun 16 18:33:34.072613 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Identity-Status: Confirmed Jun 16 18:33:34.072613 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Is-Admin-Project: True Jun 16 18:33:34.072613 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Project-Domain-Id: default Jun 16 18:33:34.072613 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Project-Domain-Name: Default Jun 16 18:33:34.072613 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Project-Id: c9fa2caa1412451aa0308c807d5c62d8 Jun 16 18:33:34.072613 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Project-Name: tempest-TestMinimumBasicScenario-1382032213 Jun 16 18:33:34.072613 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Role: reader,member Jun 16 18:33:34.072613 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Roles: reader,member Jun 16 18:33:34.075276 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/c9fa2caa1412451aa0308c807d5c62d8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/c9fa2caa1412451aa0308c807d5c62d8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_c9fa2caa1412451aa0308c807d5c62d8", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/c9fa2caa1412451aa0308c807d5c62d8"}]}] Jun 16 18:33:34.075276 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Tenant: tempest-TestMinimumBasicScenario-1382032213 Jun 16 18:33:34.075276 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Tenant-Id: c9fa2caa1412451aa0308c807d5c62d8 Jun 16 18:33:34.075276 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1382032213 Jun 16 18:33:34.075276 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-User: tempest-TestMinimumBasicScenario-1382032213-project Jun 16 18:33:34.075276 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-User-Domain-Id: default Jun 16 18:33:34.075276 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-User-Domain-Name: Default Jun 16 18:33:34.075276 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-User-Id: 0d7d57c4231b49b28a606a17e42267e7 Jun 16 18:33:34.075276 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-User-Name: tempest-TestMinimumBasicScenario-1382032213-project Jun 16 18:33:34.075276 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: method: > Jun 16 18:33:34.075276 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: exception: Instance 26fdb428-7e41-4e0f-b91a-15009844089f is not attached to volume 622a80ea-7379-4123-84e6-95a50efb3b40 Jun 16 18:33:34.076375 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: action_args: {'server_id': '26fdb428-7e41-4e0f-b91a-15009844089f', 'id': '622a80ea-7379-4123-84e6-95a50efb3b40'} Jun 16 18:33:34.076375 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:33:34.076375 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:33:34.076375 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jun 16 18:33:34.076375 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jun 16 18:33:34.076375 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 16 18:33:34.076375 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 16 18:33:34.076375 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jun 16 18:33:34.076375 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jun 16 18:33:34.076375 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 622a80ea-7379-4123-84e6-95a50efb3b40. Jun 16 18:33:34.076375 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi Jun 16 18:33:34.076375 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:33:34.076375 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi Jun 16 18:33:34.076375 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:33:34.076375 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:33:34.076375 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:33:34.076375 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:33:34.076375 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:33:34.076375 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:33:34.079054 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:33:34.079054 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jun 16 18:33:34.079054 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jun 16 18:33:34.079054 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 26fdb428-7e41-4e0f-b91a-15009844089f is not attached to volume 622a80ea-7379-4123-84e6-95a50efb3b40 Jun 16 18:33:34.079054 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi Jun 16 18:33:34.079054 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:33:34.079054 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi Jun 16 18:33:34.079054 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:33:34.079054 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:33:34.079054 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:33:34.079054 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:33:34.079054 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:33:34.079054 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 26fdb428-7e41-4e0f-b91a-15009844089f is not attached to volume 622a80ea-7379-4123-84e6-95a50efb3b40 Jun 16 18:33:34.079054 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi Jun 16 18:33:34.079054 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-3cb387e6-b9c2-45bd-9f0d-6cc3a0e0609d tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Returning 404 to user: Instance 26fdb428-7e41-4e0f-b91a-15009844089f is not attached to volume 622a80ea-7379-4123-84e6-95a50efb3b40 {{(pid=117670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:33:34.081552 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-3cb387e6-b9c2-45bd-9f0d-6cc3a0e0609d tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] 10.222.0.30 "DELETE /compute/v2.1/servers/26fdb428-7e41-4e0f-b91a-15009844089f/os-volume_attachments/622a80ea-7379-4123-84e6-95a50efb3b40" status: 404 len: 154 microversion: 2.1 time: 0.136220 Jun 16 18:33:34.081552 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 286/527] 10.222.0.30 () {58 vars in 1415 bytes} [Thu Jun 16 18:33:33 2022] DELETE /compute/v2.1/servers/26fdb428-7e41-4e0f-b91a-15009844089f/os-volume_attachments/622a80ea-7379-4123-84e6-95a50efb3b40 => generated 154 bytes in 138 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 16 18:33:34.105423 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-8204649e-472c-4ffa-8e45-985e331a9cde tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "95145fa9-8719-422d-8b3b-587cf2e2f758"}} {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:33:34.106529 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-8204649e-472c-4ffa-8e45-985e331a9cde tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] [instance: e5de32bc-4cf2-47cd-b0de-bcc77b9a5791] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:33:34.113410 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-8204649e-472c-4ffa-8e45-985e331a9cde tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:34.113869 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-8204649e-472c-4ffa-8e45-985e331a9cde tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:34.114662 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-8204649e-472c-4ffa-8e45-985e331a9cde tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:34.115102 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-8204649e-472c-4ffa-8e45-985e331a9cde tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:34.231519 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.wsgi [None req-8204649e-472c-4ffa-8e45-985e331a9cde tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] HTTP exception thrown: Invalid volume: volume 95145fa9-8719-422d-8b3b-587cf2e2f758 is already attached to instances: e5de32bc-4cf2-47cd-b0de-bcc77b9a5791 Jun 16 18:33:34.233990 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-8204649e-472c-4ffa-8e45-985e331a9cde tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Request method failure captured: Jun 16 18:33:34.233990 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: request: POST /compute/v2.1/servers/e5de32bc-4cf2-47cd-b0de-bcc77b9a5791/os-volume_attachments HTTP/1.1 Jun 16 18:33:34.233990 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: Accept: application/json Jun 16 18:33:34.233990 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: Accept-Encoding: identity Jun 16 18:33:34.233990 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: Connection: close Jun 16 18:33:34.233990 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: Content-Length: 74 Jun 16 18:33:34.233990 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: Content-Type: application/json Jun 16 18:33:34.233990 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: Host: 10.222.0.30 Jun 16 18:33:34.233990 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: Openstack-System-Scope: None Jun 16 18:33:34.233990 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: User-Agent: python-urllib3/1.26.9 Jun 16 18:33:34.233990 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Auth-Token: gAAAAABiq3ZX0T5cncUq62ubfwO6lq1Lv4hHDbhnjkkOIJCFH6tDdIm4lTs2-IIDJl9nzK-SwFmooLj6i7tKw5uiIiGwCsi7P_mYy-sE7ccdLwqhACdzBDGvbvHDziedNnH_4yw_ULKqsIs-KqEoe_8V5KONSdInylhgSWkEXyoNm7uUe3r64xc Jun 16 18:33:34.233990 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Domain-Id: None Jun 16 18:33:34.233990 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Domain-Name: None Jun 16 18:33:34.233990 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Identity-Status: Confirmed Jun 16 18:33:34.233990 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Is-Admin-Project: True Jun 16 18:33:34.233990 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Project-Domain-Id: default Jun 16 18:33:34.233990 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Project-Domain-Name: Default Jun 16 18:33:34.233990 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Project-Id: 1f0473c6214a4428be438fabc530012b Jun 16 18:33:34.233990 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Project-Name: tempest-AttachVolumeNegativeTest-1927047282 Jun 16 18:33:34.233990 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Role: reader,member Jun 16 18:33:34.233990 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Roles: reader,member Jun 16 18:33:34.237423 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/1f0473c6214a4428be438fabc530012b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/1f0473c6214a4428be438fabc530012b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_1f0473c6214a4428be438fabc530012b", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/1f0473c6214a4428be438fabc530012b"}]}] Jun 16 18:33:34.237423 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Tenant: tempest-AttachVolumeNegativeTest-1927047282 Jun 16 18:33:34.237423 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Tenant-Id: 1f0473c6214a4428be438fabc530012b Jun 16 18:33:34.237423 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1927047282 Jun 16 18:33:34.237423 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-User: tempest-AttachVolumeNegativeTest-1927047282-project Jun 16 18:33:34.237423 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-User-Domain-Id: default Jun 16 18:33:34.237423 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-User-Domain-Name: Default Jun 16 18:33:34.237423 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-User-Id: 89f6c755dbf74640a372802f02733eb3 Jun 16 18:33:34.237423 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-User-Name: tempest-AttachVolumeNegativeTest-1927047282-project Jun 16 18:33:34.237423 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: Jun 16 18:33:34.237423 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: {"volumeAttachment": {"volumeId": "95145fa9-8719-422d-8b3b-587cf2e2f758"}} Jun 16 18:33:34.237423 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: method: > Jun 16 18:33:34.239125 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: exception: Invalid volume: volume 95145fa9-8719-422d-8b3b-587cf2e2f758 is already attached to instances: e5de32bc-4cf2-47cd-b0de-bcc77b9a5791 Jun 16 18:33:34.239125 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: action_args: {'server_id': 'e5de32bc-4cf2-47cd-b0de-bcc77b9a5791', 'body': {'volumeAttachment': {'volumeId': '95145fa9-8719-422d-8b3b-587cf2e2f758'}}} Jun 16 18:33:34.239125 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:33:34.239125 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:33:34.239125 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 16 18:33:34.239125 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 16 18:33:34.239125 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 16 18:33:34.239125 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 16 18:33:34.239125 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 16 18:33:34.239125 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 16 18:33:34.239125 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jun 16 18:33:34.239125 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jun 16 18:33:34.239125 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jun 16 18:33:34.239125 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jun 16 18:33:34.239125 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 95145fa9-8719-422d-8b3b-587cf2e2f758 is already attached to instances: e5de32bc-4cf2-47cd-b0de-bcc77b9a5791 Jun 16 18:33:34.239125 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Jun 16 18:33:34.239125 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:33:34.239125 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Jun 16 18:33:34.239125 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:33:34.242552 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:33:34.242552 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:33:34.242552 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:33:34.242552 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:33:34.242552 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:33:34.242552 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:33:34.242552 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 18:33:34.242552 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 18:33:34.242552 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 18:33:34.242552 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 18:33:34.242552 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 18:33:34.242552 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 18:33:34.242552 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jun 16 18:33:34.242552 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 16 18:33:34.242552 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 95145fa9-8719-422d-8b3b-587cf2e2f758 is already attached to instances: e5de32bc-4cf2-47cd-b0de-bcc77b9a5791 Jun 16 18:33:34.242552 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Jun 16 18:33:34.242552 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:33:34.242552 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Jun 16 18:33:34.242552 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:33:34.242552 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:33:34.245392 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:33:34.245392 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:33:34.245392 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:33:34.245392 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 95145fa9-8719-422d-8b3b-587cf2e2f758 is already attached to instances: e5de32bc-4cf2-47cd-b0de-bcc77b9a5791 Jun 16 18:33:34.245392 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Jun 16 18:33:34.245392 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-8204649e-472c-4ffa-8e45-985e331a9cde tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Returning 400 to user: Invalid volume: volume 95145fa9-8719-422d-8b3b-587cf2e2f758 is already attached to instances: e5de32bc-4cf2-47cd-b0de-bcc77b9a5791 {{(pid=117671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:33:34.245392 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-8204649e-472c-4ffa-8e45-985e331a9cde tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] 10.222.0.30 "POST /compute/v2.1/servers/e5de32bc-4cf2-47cd-b0de-bcc77b9a5791/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.135245 Jun 16 18:33:34.245392 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 242/528] 10.222.0.30 () {60 vars in 1322 bytes} [Thu Jun 16 18:33:34 2022] POST /compute/v2.1/servers/e5de32bc-4cf2-47cd-b0de-bcc77b9a5791/os-volume_attachments => generated 174 bytes in 136 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jun 16 18:33:34.336977 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-e675db73-e830-48cb-91f5-ff48c1f81df7 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:33:34.337562 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-e675db73-e830-48cb-91f5-ff48c1f81df7 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] [instance: e5de32bc-4cf2-47cd-b0de-bcc77b9a5791] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:33:34.345401 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-e675db73-e830-48cb-91f5-ff48c1f81df7 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:34.346290 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-e675db73-e830-48cb-91f5-ff48c1f81df7 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:34.348622 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-e675db73-e830-48cb-91f5-ff48c1f81df7 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:34.348622 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-e675db73-e830-48cb-91f5-ff48c1f81df7 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:34.461809 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.objects.instance [None req-e675db73-e830-48cb-91f5-ff48c1f81df7 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lazy-loading 'services' on Instance uuid e5de32bc-4cf2-47cd-b0de-bcc77b9a5791 {{(pid=117670) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 18:33:34.572012 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG dbcounter [-] [117670] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=117670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:33:34.586016 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-e675db73-e830-48cb-91f5-ff48c1f81df7 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] 10.222.0.30 "DELETE /compute/v2.1/servers/e5de32bc-4cf2-47cd-b0de-bcc77b9a5791/os-volume_attachments/95145fa9-8719-422d-8b3b-587cf2e2f758" status: 202 len: 0 microversion: 2.1 time: 0.253929 Jun 16 18:33:34.586631 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 287/529] 10.222.0.30 () {58 vars in 1415 bytes} [Thu Jun 16 18:33:34 2022] DELETE /compute/v2.1/servers/e5de32bc-4cf2-47cd-b0de-bcc77b9a5791/os-volume_attachments/95145fa9-8719-422d-8b3b-587cf2e2f758 => generated 0 bytes in 256 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 16 18:33:34.595686 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-b99e0fdc-bb3a-4361-b28c-1480e0d6fcac tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:33:34.596678 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-b99e0fdc-bb3a-4361-b28c-1480e0d6fcac tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] [instance: e5de32bc-4cf2-47cd-b0de-bcc77b9a5791] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:33:34.604389 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-b99e0fdc-bb3a-4361-b28c-1480e0d6fcac tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:34.604847 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-b99e0fdc-bb3a-4361-b28c-1480e0d6fcac tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:34.605642 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-b99e0fdc-bb3a-4361-b28c-1480e0d6fcac tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:34.606085 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-b99e0fdc-bb3a-4361-b28c-1480e0d6fcac tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:34.611669 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG dbcounter [-] [117671] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:33:34.650114 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-b99e0fdc-bb3a-4361-b28c-1480e0d6fcac tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] 10.222.0.30 "GET /compute/v2.1/servers/e5de32bc-4cf2-47cd-b0de-bcc77b9a5791/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056808 Jun 16 18:33:34.650114 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 243/530] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Jun 16 18:33:34 2022] GET /compute/v2.1/servers/e5de32bc-4cf2-47cd-b0de-bcc77b9a5791/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:33:35.294488 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-065e305c-fc0b-48b2-9095-cc10ee3b0fc8 tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:33:35.295148 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-065e305c-fc0b-48b2-9095-cc10ee3b0fc8 tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] [instance: 26fdb428-7e41-4e0f-b91a-15009844089f] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:33:35.303787 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-065e305c-fc0b-48b2-9095-cc10ee3b0fc8 tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:35.304582 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-065e305c-fc0b-48b2-9095-cc10ee3b0fc8 tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:35.305458 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-065e305c-fc0b-48b2-9095-cc10ee3b0fc8 tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:35.305902 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-065e305c-fc0b-48b2-9095-cc10ee3b0fc8 tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:35.334075 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-065e305c-fc0b-48b2-9095-cc10ee3b0fc8 tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] [instance: 26fdb428-7e41-4e0f-b91a-15009844089f] Going to try to terminate instance {{(pid=117670) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 18:33:35.455187 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-065e305c-fc0b-48b2-9095-cc10ee3b0fc8 tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] 10.222.0.30 "DELETE /compute/v2.1/servers/26fdb428-7e41-4e0f-b91a-15009844089f" status: 204 len: 0 microversion: 2.1 time: 0.164924 Jun 16 18:33:35.456778 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 288/531] 10.222.0.30 () {58 vars in 1238 bytes} [Thu Jun 16 18:33:35 2022] DELETE /compute/v2.1/servers/26fdb428-7e41-4e0f-b91a-15009844089f => generated 0 bytes in 169 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 18:33:35.467868 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-0e80cb68-f6cb-4e67-a1e8-5d1644c359d1 tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:33:35.468948 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-0e80cb68-f6cb-4e67-a1e8-5d1644c359d1 tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] [instance: 26fdb428-7e41-4e0f-b91a-15009844089f] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:33:35.479363 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-0e80cb68-f6cb-4e67-a1e8-5d1644c359d1 tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:35.480077 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-0e80cb68-f6cb-4e67-a1e8-5d1644c359d1 tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:35.481039 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-0e80cb68-f6cb-4e67-a1e8-5d1644c359d1 tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:35.481782 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-0e80cb68-f6cb-4e67-a1e8-5d1644c359d1 tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:35.664925 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-9ef83773-60ee-401f-9852-2c580b6da8d7 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:33:35.665977 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-9ef83773-60ee-401f-9852-2c580b6da8d7 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] [instance: e5de32bc-4cf2-47cd-b0de-bcc77b9a5791] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:33:35.669978 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-0e80cb68-f6cb-4e67-a1e8-5d1644c359d1 tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7d57c4231b49b28a606a17e42267e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9fa2caa1412451aa0308c807d5c62d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:33:35.673020 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-9ef83773-60ee-401f-9852-2c580b6da8d7 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:35.673478 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-9ef83773-60ee-401f-9852-2c580b6da8d7 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:35.674248 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-9ef83773-60ee-401f-9852-2c580b6da8d7 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:35.674677 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-9ef83773-60ee-401f-9852-2c580b6da8d7 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:35.686001 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-0e80cb68-f6cb-4e67-a1e8-5d1644c359d1 tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] 10.222.0.30 "GET /compute/v2.1/servers/26fdb428-7e41-4e0f-b91a-15009844089f" status: 200 len: 1555 microversion: 2.1 time: 0.222450 Jun 16 18:33:35.687171 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 244/532] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:33:35 2022] GET /compute/v2.1/servers/26fdb428-7e41-4e0f-b91a-15009844089f => generated 1555 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:33:35.710177 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-9ef83773-60ee-401f-9852-2c580b6da8d7 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] 10.222.0.30 "GET /compute/v2.1/servers/e5de32bc-4cf2-47cd-b0de-bcc77b9a5791/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050259 Jun 16 18:33:35.710655 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 289/533] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Jun 16 18:33:35 2022] GET /compute/v2.1/servers/e5de32bc-4cf2-47cd-b0de-bcc77b9a5791/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 16 18:33:35.776435 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-5cd199cc-bb87-4e2a-87cf-3e034474e101 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:33:35.776989 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-5cd199cc-bb87-4e2a-87cf-3e034474e101 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] [instance: e5de32bc-4cf2-47cd-b0de-bcc77b9a5791] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:33:35.783850 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-5cd199cc-bb87-4e2a-87cf-3e034474e101 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:35.784378 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-5cd199cc-bb87-4e2a-87cf-3e034474e101 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:35.785229 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-5cd199cc-bb87-4e2a-87cf-3e034474e101 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:35.785735 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-5cd199cc-bb87-4e2a-87cf-3e034474e101 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:35.817590 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-5cd199cc-bb87-4e2a-87cf-3e034474e101 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] [instance: e5de32bc-4cf2-47cd-b0de-bcc77b9a5791] Going to try to terminate instance {{(pid=117671) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 18:33:35.914146 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-5cd199cc-bb87-4e2a-87cf-3e034474e101 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] 10.222.0.30 "DELETE /compute/v2.1/servers/e5de32bc-4cf2-47cd-b0de-bcc77b9a5791" status: 204 len: 0 microversion: 2.1 time: 0.141488 Jun 16 18:33:35.914783 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 245/534] 10.222.0.30 () {58 vars in 1238 bytes} [Thu Jun 16 18:33:35 2022] DELETE /compute/v2.1/servers/e5de32bc-4cf2-47cd-b0de-bcc77b9a5791 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 16 18:33:35.924371 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-3180e985-b5d9-4a2e-a6ff-03a04ae843f4 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:33:35.925516 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-3180e985-b5d9-4a2e-a6ff-03a04ae843f4 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] [instance: e5de32bc-4cf2-47cd-b0de-bcc77b9a5791] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:33:35.933931 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-3180e985-b5d9-4a2e-a6ff-03a04ae843f4 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:35.934385 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-3180e985-b5d9-4a2e-a6ff-03a04ae843f4 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:35.935179 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-3180e985-b5d9-4a2e-a6ff-03a04ae843f4 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:35.935623 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-3180e985-b5d9-4a2e-a6ff-03a04ae843f4 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:36.104037 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-3180e985-b5d9-4a2e-a6ff-03a04ae843f4 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f6c755dbf74640a372802f02733eb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f0473c6214a4428be438fabc530012b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:33:36.112262 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-3180e985-b5d9-4a2e-a6ff-03a04ae843f4 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] 10.222.0.30 "GET /compute/v2.1/servers/e5de32bc-4cf2-47cd-b0de-bcc77b9a5791" status: 200 len: 1679 microversion: 2.1 time: 0.192654 Jun 16 18:33:36.112869 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 290/535] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:33:35 2022] GET /compute/v2.1/servers/e5de32bc-4cf2-47cd-b0de-bcc77b9a5791 => generated 1679 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:33:36.710407 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-0af72f8d-a790-4322-a43e-69101899d33a tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:33:36.711180 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-0af72f8d-a790-4322-a43e-69101899d33a tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] [instance: 26fdb428-7e41-4e0f-b91a-15009844089f] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:33:36.718622 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-0af72f8d-a790-4322-a43e-69101899d33a tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:36.719105 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-0af72f8d-a790-4322-a43e-69101899d33a tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:36.720179 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-0af72f8d-a790-4322-a43e-69101899d33a tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:36.720733 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-0af72f8d-a790-4322-a43e-69101899d33a tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:36.878313 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-0af72f8d-a790-4322-a43e-69101899d33a tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7d57c4231b49b28a606a17e42267e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9fa2caa1412451aa0308c807d5c62d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:33:36.893307 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-0af72f8d-a790-4322-a43e-69101899d33a tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] 10.222.0.30 "GET /compute/v2.1/servers/26fdb428-7e41-4e0f-b91a-15009844089f" status: 200 len: 1555 microversion: 2.1 time: 0.187734 Jun 16 18:33:36.894390 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 246/536] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:33:36 2022] GET /compute/v2.1/servers/26fdb428-7e41-4e0f-b91a-15009844089f => generated 1555 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:33:37.130592 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-68a5b7cb-fe62-4730-b240-fcd7abfe4b67 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:33:37.132792 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-68a5b7cb-fe62-4730-b240-fcd7abfe4b67 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] [instance: e5de32bc-4cf2-47cd-b0de-bcc77b9a5791] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:33:37.136972 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG dbcounter [-] [117670] Writing DB stats nova_api:SELECT=55,nova_api:UPDATE=1 {{(pid=117670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:33:37.149225 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-68a5b7cb-fe62-4730-b240-fcd7abfe4b67 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:37.150038 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-68a5b7cb-fe62-4730-b240-fcd7abfe4b67 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:37.151445 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-68a5b7cb-fe62-4730-b240-fcd7abfe4b67 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:37.152268 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-68a5b7cb-fe62-4730-b240-fcd7abfe4b67 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:37.330913 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-68a5b7cb-fe62-4730-b240-fcd7abfe4b67 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f6c755dbf74640a372802f02733eb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f0473c6214a4428be438fabc530012b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:33:37.339774 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-68a5b7cb-fe62-4730-b240-fcd7abfe4b67 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] 10.222.0.30 "GET /compute/v2.1/servers/e5de32bc-4cf2-47cd-b0de-bcc77b9a5791" status: 200 len: 1679 microversion: 2.1 time: 0.213219 Jun 16 18:33:37.340420 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 291/537] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:33:37 2022] GET /compute/v2.1/servers/e5de32bc-4cf2-47cd-b0de-bcc77b9a5791 => generated 1679 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:33:37.920736 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-a7f658aa-00d8-48f0-b4ec-8bae2d7f9707 tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:33:37.921927 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-a7f658aa-00d8-48f0-b4ec-8bae2d7f9707 tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] [instance: 26fdb428-7e41-4e0f-b91a-15009844089f] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:33:37.930052 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-a7f658aa-00d8-48f0-b4ec-8bae2d7f9707 tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:37.930506 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-a7f658aa-00d8-48f0-b4ec-8bae2d7f9707 tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:37.931303 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-a7f658aa-00d8-48f0-b4ec-8bae2d7f9707 tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:37.931741 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-a7f658aa-00d8-48f0-b4ec-8bae2d7f9707 tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:38.086673 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-a7f658aa-00d8-48f0-b4ec-8bae2d7f9707 tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7d57c4231b49b28a606a17e42267e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9fa2caa1412451aa0308c807d5c62d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:33:38.095092 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-a7f658aa-00d8-48f0-b4ec-8bae2d7f9707 tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] 10.222.0.30 "GET /compute/v2.1/servers/26fdb428-7e41-4e0f-b91a-15009844089f" status: 200 len: 1555 microversion: 2.1 time: 0.178428 Jun 16 18:33:38.095693 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 247/538] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:33:37 2022] GET /compute/v2.1/servers/26fdb428-7e41-4e0f-b91a-15009844089f => generated 1555 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:33:38.357256 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-786e07b2-a648-4fdc-a17d-677b3731fab1 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:33:38.357949 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-786e07b2-a648-4fdc-a17d-677b3731fab1 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] [instance: e5de32bc-4cf2-47cd-b0de-bcc77b9a5791] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:33:38.365042 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-786e07b2-a648-4fdc-a17d-677b3731fab1 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:38.365628 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-786e07b2-a648-4fdc-a17d-677b3731fab1 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:38.366947 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-786e07b2-a648-4fdc-a17d-677b3731fab1 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:38.367569 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-786e07b2-a648-4fdc-a17d-677b3731fab1 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:38.526870 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-786e07b2-a648-4fdc-a17d-677b3731fab1 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f6c755dbf74640a372802f02733eb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f0473c6214a4428be438fabc530012b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:33:38.541582 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-786e07b2-a648-4fdc-a17d-677b3731fab1 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] 10.222.0.30 "GET /compute/v2.1/servers/e5de32bc-4cf2-47cd-b0de-bcc77b9a5791" status: 200 len: 1679 microversion: 2.1 time: 0.187728 Jun 16 18:33:38.542607 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 292/539] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:33:38 2022] GET /compute/v2.1/servers/e5de32bc-4cf2-47cd-b0de-bcc77b9a5791 => generated 1679 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:33:39.115429 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-957193f6-0f92-4d2a-b330-ff8d8409e82a tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:33:39.118465 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-957193f6-0f92-4d2a-b330-ff8d8409e82a tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] [instance: 26fdb428-7e41-4e0f-b91a-15009844089f] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:33:39.130275 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-957193f6-0f92-4d2a-b330-ff8d8409e82a tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:39.131658 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-957193f6-0f92-4d2a-b330-ff8d8409e82a tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:39.132624 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-957193f6-0f92-4d2a-b330-ff8d8409e82a tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:39.133363 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-957193f6-0f92-4d2a-b330-ff8d8409e82a tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:39.431830 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [req-bb6bbb4d-005d-423d-b8e3-3625db7f479a req-8b6987dc-e1bd-4f86-82cd-9c1706d3ad93 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26fdb428-7e41-4e0f-b91a-15009844089f", "name": "network-vif-deleted", "tag": "60aa1d76-6fda-4493-91ab-da6bd2ca0a42"}]} {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:33:39.443050 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [req-bb6bbb4d-005d-423d-b8e3-3625db7f479a req-8b6987dc-e1bd-4f86-82cd-9c1706d3ad93 service nova] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:39.443491 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [req-bb6bbb4d-005d-423d-b8e3-3625db7f479a req-8b6987dc-e1bd-4f86-82cd-9c1706d3ad93 service nova] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:39.456413 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.compute.server_external_events [req-bb6bbb4d-005d-423d-b8e3-3625db7f479a req-8b6987dc-e1bd-4f86-82cd-9c1706d3ad93 service nova] Creating event network-vif-deleted:60aa1d76-6fda-4493-91ab-da6bd2ca0a42 for instance 26fdb428-7e41-4e0f-b91a-15009844089f on hv-cinder-81322 Jun 16 18:33:39.463661 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [req-bb6bbb4d-005d-423d-b8e3-3625db7f479a req-8b6987dc-e1bd-4f86-82cd-9c1706d3ad93 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036030 Jun 16 18:33:39.464376 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 293/540] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Jun 16 18:33:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:33:39.531571 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-957193f6-0f92-4d2a-b330-ff8d8409e82a tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7d57c4231b49b28a606a17e42267e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9fa2caa1412451aa0308c807d5c62d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:33:39.547036 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-957193f6-0f92-4d2a-b330-ff8d8409e82a tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] 10.222.0.30 "GET /compute/v2.1/servers/26fdb428-7e41-4e0f-b91a-15009844089f" status: 200 len: 1555 microversion: 2.1 time: 0.435568 Jun 16 18:33:39.548318 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 248/541] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:33:39 2022] GET /compute/v2.1/servers/26fdb428-7e41-4e0f-b91a-15009844089f => generated 1555 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:33:39.563832 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-303150e7-e0d0-4952-92aa-9a314ceaf5a1 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:33:39.565021 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-303150e7-e0d0-4952-92aa-9a314ceaf5a1 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] [instance: e5de32bc-4cf2-47cd-b0de-bcc77b9a5791] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:33:39.576919 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-303150e7-e0d0-4952-92aa-9a314ceaf5a1 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:39.578234 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-303150e7-e0d0-4952-92aa-9a314ceaf5a1 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:39.579920 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-303150e7-e0d0-4952-92aa-9a314ceaf5a1 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:39.580728 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-303150e7-e0d0-4952-92aa-9a314ceaf5a1 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:39.785657 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-303150e7-e0d0-4952-92aa-9a314ceaf5a1 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f6c755dbf74640a372802f02733eb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f0473c6214a4428be438fabc530012b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:33:39.801790 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-303150e7-e0d0-4952-92aa-9a314ceaf5a1 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] 10.222.0.30 "GET /compute/v2.1/servers/e5de32bc-4cf2-47cd-b0de-bcc77b9a5791" status: 200 len: 1679 microversion: 2.1 time: 0.243371 Jun 16 18:33:39.802638 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 294/542] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:33:39 2022] GET /compute/v2.1/servers/e5de32bc-4cf2-47cd-b0de-bcc77b9a5791 => generated 1679 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:33:40.570217 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-eab4fcfe-d55d-44ad-accf-1e15a30b1db2 tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:33:40.572400 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-eab4fcfe-d55d-44ad-accf-1e15a30b1db2 tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] [instance: 26fdb428-7e41-4e0f-b91a-15009844089f] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:33:40.585314 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-eab4fcfe-d55d-44ad-accf-1e15a30b1db2 tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:40.586123 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-eab4fcfe-d55d-44ad-accf-1e15a30b1db2 tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:40.587522 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-eab4fcfe-d55d-44ad-accf-1e15a30b1db2 tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:40.588661 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-eab4fcfe-d55d-44ad-accf-1e15a30b1db2 tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:40.617035 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.wsgi [None req-eab4fcfe-d55d-44ad-accf-1e15a30b1db2 tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] HTTP exception thrown: Instance 26fdb428-7e41-4e0f-b91a-15009844089f could not be found. Jun 16 18:33:40.621104 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-eab4fcfe-d55d-44ad-accf-1e15a30b1db2 tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Request method failure captured: Jun 16 18:33:40.621104 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: request: GET /compute/v2.1/servers/26fdb428-7e41-4e0f-b91a-15009844089f HTTP/1.1 Jun 16 18:33:40.621104 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: Accept: application/json Jun 16 18:33:40.621104 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: Accept-Encoding: identity Jun 16 18:33:40.621104 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: Connection: close Jun 16 18:33:40.621104 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: Content-Length: 0 Jun 16 18:33:40.621104 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: Content-Type: application/json Jun 16 18:33:40.621104 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: Host: 10.222.0.30 Jun 16 18:33:40.621104 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: Openstack-System-Scope: None Jun 16 18:33:40.621104 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: User-Agent: python-urllib3/1.26.9 Jun 16 18:33:40.621104 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Auth-Token: gAAAAABiq3a-soRipyqPTEjwIOFTpkhmWuBEjRzmocqjH0s5N8R-uVIrVdFDyIhP-6nzIYUJBVsBgI8fIT1FHudSYxDg2BS76vyy_Hm6o9-q7EFEHTE0y_mwWnDKLgfhWOZBw5IbAWut9ZO6UqKTawZvvqkdyyLGR1oQEH9AKTeV-n590oTDEZ8 Jun 16 18:33:40.621104 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Domain-Id: None Jun 16 18:33:40.621104 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Domain-Name: None Jun 16 18:33:40.621104 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Identity-Status: Confirmed Jun 16 18:33:40.621104 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Is-Admin-Project: True Jun 16 18:33:40.621104 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Project-Domain-Id: default Jun 16 18:33:40.621104 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Project-Domain-Name: Default Jun 16 18:33:40.621104 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Project-Id: c9fa2caa1412451aa0308c807d5c62d8 Jun 16 18:33:40.621104 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Project-Name: tempest-TestMinimumBasicScenario-1382032213 Jun 16 18:33:40.621104 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Role: reader,member Jun 16 18:33:40.621104 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Roles: reader,member Jun 16 18:33:40.624310 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/c9fa2caa1412451aa0308c807d5c62d8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/c9fa2caa1412451aa0308c807d5c62d8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_c9fa2caa1412451aa0308c807d5c62d8", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/c9fa2caa1412451aa0308c807d5c62d8"}]}] Jun 16 18:33:40.624310 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Tenant: tempest-TestMinimumBasicScenario-1382032213 Jun 16 18:33:40.624310 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Tenant-Id: c9fa2caa1412451aa0308c807d5c62d8 Jun 16 18:33:40.624310 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1382032213 Jun 16 18:33:40.624310 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-User: tempest-TestMinimumBasicScenario-1382032213-project Jun 16 18:33:40.624310 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-User-Domain-Id: default Jun 16 18:33:40.624310 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-User-Domain-Name: Default Jun 16 18:33:40.624310 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-User-Id: 0d7d57c4231b49b28a606a17e42267e7 Jun 16 18:33:40.624310 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-User-Name: tempest-TestMinimumBasicScenario-1382032213-project Jun 16 18:33:40.624310 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: method: > Jun 16 18:33:40.624310 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: exception: Instance 26fdb428-7e41-4e0f-b91a-15009844089f could not be found. Jun 16 18:33:40.624310 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: action_args: {'id': '26fdb428-7e41-4e0f-b91a-15009844089f'} Jun 16 18:33:40.625789 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:33:40.625789 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:33:40.625789 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 18:33:40.625789 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 18:33:40.625789 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 18:33:40.625789 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 18:33:40.625789 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 18:33:40.625789 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 18:33:40.625789 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 18:33:40.625789 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 18:33:40.625789 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 26fdb428-7e41-4e0f-b91a-15009844089f could not be found. Jun 16 18:33:40.625789 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Jun 16 18:33:40.625789 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:33:40.625789 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Jun 16 18:33:40.625789 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:33:40.625789 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:33:40.625789 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:33:40.625789 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:33:40.625789 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:33:40.625789 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:33:40.628479 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:33:40.628479 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 18:33:40.628479 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 18:33:40.628479 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 18:33:40.628479 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 18:33:40.628479 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 18:33:40.628479 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:33:40.628479 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 26fdb428-7e41-4e0f-b91a-15009844089f could not be found. Jun 16 18:33:40.628479 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Jun 16 18:33:40.628479 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:33:40.628479 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Jun 16 18:33:40.628479 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:33:40.628479 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:33:40.628479 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:33:40.628479 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:33:40.628479 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:33:40.628479 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 26fdb428-7e41-4e0f-b91a-15009844089f could not be found. Jun 16 18:33:40.628479 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Jun 16 18:33:40.631829 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-eab4fcfe-d55d-44ad-accf-1e15a30b1db2 tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Returning 404 to user: Instance 26fdb428-7e41-4e0f-b91a-15009844089f could not be found. {{(pid=117671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:33:40.631829 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-eab4fcfe-d55d-44ad-accf-1e15a30b1db2 tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] 10.222.0.30 "GET /compute/v2.1/servers/26fdb428-7e41-4e0f-b91a-15009844089f" status: 404 len: 111 microversion: 2.1 time: 0.061351 Jun 16 18:33:40.631829 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 249/543] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:33:40 2022] GET /compute/v2.1/servers/26fdb428-7e41-4e0f-b91a-15009844089f => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:33:40.636207 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-54570984-64ab-4c52-a614-b673f647046b tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] Calling method '.version_select at 0x7fbb23e60d30>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:33:40.672636 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-54570984-64ab-4c52-a614-b673f647046b tempest-TestMinimumBasicScenario-1382032213 tempest-TestMinimumBasicScenario-1382032213-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1502264594" status: 202 len: 0 microversion: 2.1 time: 0.040035 Jun 16 18:33:40.673703 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 295/544] 10.222.0.30 () {58 vars in 1271 bytes} [Thu Jun 16 18:33:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1502264594 => generated 0 bytes in 43 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 16 18:33:40.714445 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [req-6475dad7-b764-4918-9f76-592cbbe5dd0b req-72328e8a-a3b4-44fa-b789-af1f4615e811 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5de32bc-4cf2-47cd-b0de-bcc77b9a5791", "name": "network-vif-deleted", "tag": "2e698a2a-6a45-4d55-a4e3-1a1a739951af"}]} {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:33:40.723742 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [req-6475dad7-b764-4918-9f76-592cbbe5dd0b req-72328e8a-a3b4-44fa-b789-af1f4615e811 service nova] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:40.724144 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [req-6475dad7-b764-4918-9f76-592cbbe5dd0b req-72328e8a-a3b4-44fa-b789-af1f4615e811 service nova] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:40.742709 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.compute.server_external_events [req-6475dad7-b764-4918-9f76-592cbbe5dd0b req-72328e8a-a3b4-44fa-b789-af1f4615e811 service nova] Creating event network-vif-deleted:2e698a2a-6a45-4d55-a4e3-1a1a739951af for instance e5de32bc-4cf2-47cd-b0de-bcc77b9a5791 on hv-cinder-81322 Jun 16 18:33:40.748666 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [req-6475dad7-b764-4918-9f76-592cbbe5dd0b req-72328e8a-a3b4-44fa-b789-af1f4615e811 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038271 Jun 16 18:33:40.749439 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 250/545] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Jun 16 18:33:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 18:33:40.960166 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-e507dbc0-6b80-4b48-afeb-f327ee435758 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:33:40.961165 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-e507dbc0-6b80-4b48-afeb-f327ee435758 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] [instance: e5de32bc-4cf2-47cd-b0de-bcc77b9a5791] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:33:40.982465 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-e507dbc0-6b80-4b48-afeb-f327ee435758 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:40.983627 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-e507dbc0-6b80-4b48-afeb-f327ee435758 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:40.986140 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-e507dbc0-6b80-4b48-afeb-f327ee435758 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:40.986560 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-e507dbc0-6b80-4b48-afeb-f327ee435758 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:41.056691 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-e507dbc0-6b80-4b48-afeb-f327ee435758 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:41.057506 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-e507dbc0-6b80-4b48-afeb-f327ee435758 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:41.058327 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.objects.instance [None req-e507dbc0-6b80-4b48-afeb-f327ee435758 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lazy-loading 'fault' on Instance uuid e5de32bc-4cf2-47cd-b0de-bcc77b9a5791 {{(pid=117670) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 18:33:41.117539 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-e507dbc0-6b80-4b48-afeb-f327ee435758 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f6c755dbf74640a372802f02733eb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f0473c6214a4428be438fabc530012b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:33:41.126717 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-e507dbc0-6b80-4b48-afeb-f327ee435758 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] 10.222.0.30 "GET /compute/v2.1/servers/e5de32bc-4cf2-47cd-b0de-bcc77b9a5791" status: 200 len: 1331 microversion: 2.1 time: 0.306190 Jun 16 18:33:41.127331 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 296/546] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:33:40 2022] GET /compute/v2.1/servers/e5de32bc-4cf2-47cd-b0de-bcc77b9a5791 => generated 1331 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:33:42.147163 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-f8dec83a-877e-41b4-a076-e4bf9db86738 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:33:42.148193 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-f8dec83a-877e-41b4-a076-e4bf9db86738 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] [instance: e5de32bc-4cf2-47cd-b0de-bcc77b9a5791] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:33:42.155690 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-f8dec83a-877e-41b4-a076-e4bf9db86738 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:42.156662 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-f8dec83a-877e-41b4-a076-e4bf9db86738 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:42.157817 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-f8dec83a-877e-41b4-a076-e4bf9db86738 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:42.158260 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-f8dec83a-877e-41b4-a076-e4bf9db86738 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:42.176679 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.wsgi [None req-f8dec83a-877e-41b4-a076-e4bf9db86738 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] HTTP exception thrown: Instance e5de32bc-4cf2-47cd-b0de-bcc77b9a5791 could not be found. Jun 16 18:33:42.178818 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-f8dec83a-877e-41b4-a076-e4bf9db86738 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Request method failure captured: Jun 16 18:33:42.178818 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: request: GET /compute/v2.1/servers/e5de32bc-4cf2-47cd-b0de-bcc77b9a5791 HTTP/1.1 Jun 16 18:33:42.178818 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: Accept: application/json Jun 16 18:33:42.178818 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: Accept-Encoding: identity Jun 16 18:33:42.178818 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: Connection: close Jun 16 18:33:42.178818 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: Content-Length: 0 Jun 16 18:33:42.178818 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: Content-Type: application/json Jun 16 18:33:42.178818 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: Host: 10.222.0.30 Jun 16 18:33:42.178818 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: Openstack-System-Scope: None Jun 16 18:33:42.178818 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: User-Agent: python-urllib3/1.26.9 Jun 16 18:33:42.178818 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Auth-Token: gAAAAABiq3ZX0T5cncUq62ubfwO6lq1Lv4hHDbhnjkkOIJCFH6tDdIm4lTs2-IIDJl9nzK-SwFmooLj6i7tKw5uiIiGwCsi7P_mYy-sE7ccdLwqhACdzBDGvbvHDziedNnH_4yw_ULKqsIs-KqEoe_8V5KONSdInylhgSWkEXyoNm7uUe3r64xc Jun 16 18:33:42.178818 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Domain-Id: None Jun 16 18:33:42.178818 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Domain-Name: None Jun 16 18:33:42.178818 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Identity-Status: Confirmed Jun 16 18:33:42.178818 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Is-Admin-Project: True Jun 16 18:33:42.178818 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Project-Domain-Id: default Jun 16 18:33:42.178818 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Project-Domain-Name: Default Jun 16 18:33:42.178818 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Project-Id: 1f0473c6214a4428be438fabc530012b Jun 16 18:33:42.178818 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Project-Name: tempest-AttachVolumeNegativeTest-1927047282 Jun 16 18:33:42.178818 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Role: reader,member Jun 16 18:33:42.178818 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Roles: reader,member Jun 16 18:33:42.181950 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/1f0473c6214a4428be438fabc530012b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/1f0473c6214a4428be438fabc530012b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_1f0473c6214a4428be438fabc530012b", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/1f0473c6214a4428be438fabc530012b"}]}] Jun 16 18:33:42.181950 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Tenant: tempest-AttachVolumeNegativeTest-1927047282 Jun 16 18:33:42.181950 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Tenant-Id: 1f0473c6214a4428be438fabc530012b Jun 16 18:33:42.181950 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1927047282 Jun 16 18:33:42.181950 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-User: tempest-AttachVolumeNegativeTest-1927047282-project Jun 16 18:33:42.181950 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-User-Domain-Id: default Jun 16 18:33:42.181950 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-User-Domain-Name: Default Jun 16 18:33:42.181950 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-User-Id: 89f6c755dbf74640a372802f02733eb3 Jun 16 18:33:42.181950 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-User-Name: tempest-AttachVolumeNegativeTest-1927047282-project Jun 16 18:33:42.181950 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: method: > Jun 16 18:33:42.181950 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: exception: Instance e5de32bc-4cf2-47cd-b0de-bcc77b9a5791 could not be found. Jun 16 18:33:42.181950 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: action_args: {'id': 'e5de32bc-4cf2-47cd-b0de-bcc77b9a5791'} Jun 16 18:33:42.183365 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:33:42.183365 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:33:42.183365 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 18:33:42.183365 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 18:33:42.183365 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 18:33:42.183365 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 18:33:42.183365 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 18:33:42.183365 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 18:33:42.183365 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 18:33:42.183365 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 18:33:42.183365 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e5de32bc-4cf2-47cd-b0de-bcc77b9a5791 could not be found. Jun 16 18:33:42.183365 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Jun 16 18:33:42.183365 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:33:42.183365 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Jun 16 18:33:42.183365 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:33:42.183365 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:33:42.183365 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:33:42.183365 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:33:42.183365 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:33:42.183365 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:33:42.186303 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:33:42.186303 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 18:33:42.186303 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 18:33:42.186303 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 18:33:42.186303 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 18:33:42.186303 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 18:33:42.186303 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:33:42.186303 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e5de32bc-4cf2-47cd-b0de-bcc77b9a5791 could not be found. Jun 16 18:33:42.186303 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Jun 16 18:33:42.186303 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:33:42.186303 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Jun 16 18:33:42.186303 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:33:42.186303 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:33:42.186303 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:33:42.186303 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:33:42.186303 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:33:42.186303 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e5de32bc-4cf2-47cd-b0de-bcc77b9a5791 could not be found. Jun 16 18:33:42.186303 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Jun 16 18:33:42.188385 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-f8dec83a-877e-41b4-a076-e4bf9db86738 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Returning 404 to user: Instance e5de32bc-4cf2-47cd-b0de-bcc77b9a5791 could not be found. {{(pid=117671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:33:42.188385 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-f8dec83a-877e-41b4-a076-e4bf9db86738 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] 10.222.0.30 "GET /compute/v2.1/servers/e5de32bc-4cf2-47cd-b0de-bcc77b9a5791" status: 404 len: 111 microversion: 2.1 time: 0.037838 Jun 16 18:33:42.188385 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 251/547] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:33:42 2022] GET /compute/v2.1/servers/e5de32bc-4cf2-47cd-b0de-bcc77b9a5791 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:33:42.192843 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-df627df4-8e13-4cc9-a62f-047990730d8e tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Calling method '.version_select at 0x7fbb23e60ca0>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:33:42.220440 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-df627df4-8e13-4cc9-a62f-047990730d8e tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-306961846" status: 202 len: 0 microversion: 2.1 time: 0.032967 Jun 16 18:33:42.221453 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 297/548] 10.222.0.30 () {58 vars in 1217 bytes} [Thu Jun 16 18:33:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-306961846 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 18:33:43.145173 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-9be921ff-4636-49fe-b914-6b109ed5782b tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Action: 'create', calling method: .version_select at 0x7fbb23d6c040>, body: {"keypair": {"name": "tempest-keypair-283059063", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJVupAP0rf1mLofpvRgajYyl+MItmIGIeoOVwrVxc1AjJpDZJEMlJjbcX7S3UDQ3aTW5B1/mE05ehhKLj8Os1UJlrlAHTPdkwy2O0Jp75YSaoANM+il+Ib3wWSjJEvoBWA=="}} {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:33:43.173048 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.quota [None req-9be921ff-4636-49fe-b914-6b109ed5782b tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Getting quotas for project 1f0473c6214a4428be438fabc530012b. Resources: {'key_pairs'} {{(pid=117671) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 18:33:43.180830 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.quota [None req-9be921ff-4636-49fe-b914-6b109ed5782b tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Getting quotas for user 89f6c755dbf74640a372802f02733eb3 and project 1f0473c6214a4428be438fabc530012b. Resources: {'key_pairs'} {{(pid=117671) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 18:33:43.219076 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-9be921ff-4636-49fe-b914-6b109ed5782b tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.081123 Jun 16 18:33:43.220190 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 252/549] 10.222.0.30 () {60 vars in 1158 bytes} [Thu Jun 16 18:33:43 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:33:44.971815 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-e50d8b31-2e52-4f7e-a9a5-34d89f92b94a tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-322807054", "imageRef": "38ef083a-a9ff-4836-8954-f770268ba205", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8dc64fea-6d01-44bc-9636-d5525e5d1ec1"}], "security_groups": [{"name": "tempest-securitygroup--1406073303"}], "key_name": "tempest-keypair-283059063", "user_data": "}} {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:33:45.180371 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.network.neutron [None req-e50d8b31-2e52-4f7e-a9a5-34d89f92b94a tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] validate_networks() for [('8dc64fea-6d01-44bc-9636-d5525e5d1ec1', None, None, None, None, None)] {{(pid=117670) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 18:33:46.197522 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.virt.hardware [None req-e50d8b31-2e52-4f7e-a9a5-34d89f92b94a tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Flavor limits 0:0:0 {{(pid=117670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 18:33:46.199506 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.virt.hardware [None req-e50d8b31-2e52-4f7e-a9a5-34d89f92b94a tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Image limits 0:0:0 {{(pid=117670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 18:33:46.200412 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.virt.hardware [None req-e50d8b31-2e52-4f7e-a9a5-34d89f92b94a tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Flavor pref 0:0:0 {{(pid=117670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 18:33:46.201146 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.virt.hardware [None req-e50d8b31-2e52-4f7e-a9a5-34d89f92b94a tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Image pref 0:0:0 {{(pid=117670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 18:33:46.201852 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.virt.hardware [None req-e50d8b31-2e52-4f7e-a9a5-34d89f92b94a tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 18:33:46.218347 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-e50d8b31-2e52-4f7e-a9a5-34d89f92b94a tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:46.219058 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-e50d8b31-2e52-4f7e-a9a5-34d89f92b94a tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:46.220570 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-e50d8b31-2e52-4f7e-a9a5-34d89f92b94a tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:46.221355 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-e50d8b31-2e52-4f7e-a9a5-34d89f92b94a tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:46.255799 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.quota [None req-e50d8b31-2e52-4f7e-a9a5-34d89f92b94a tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Getting quotas for project 1f0473c6214a4428be438fabc530012b. Resources: {'instances', 'ram', 'cores'} {{(pid=117670) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 18:33:46.261056 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.quota [None req-e50d8b31-2e52-4f7e-a9a5-34d89f92b94a tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Getting quotas for user 89f6c755dbf74640a372802f02733eb3 and project 1f0473c6214a4428be438fabc530012b. Resources: {'instances', 'ram', 'cores'} {{(pid=117670) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 18:33:46.274134 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-e50d8b31-2e52-4f7e-a9a5-34d89f92b94a tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Going to run 1 instances... {{(pid=117670) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 18:33:46.276449 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-e50d8b31-2e52-4f7e-a9a5-34d89f92b94a tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] [instance: 3827385c-be20-4887-9735-0e5e54113151] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='38ef083a-a9ff-4836-8954-f770268ba205',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117670) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 18:33:46.338005 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-e50d8b31-2e52-4f7e-a9a5-34d89f92b94a tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.375426 Jun 16 18:33:46.338660 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 298/550] 10.222.0.30 () {60 vars in 1146 bytes} [Thu Jun 16 18:33:44 2022] POST /compute/v2.1/servers => generated 402 bytes in 1377 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 18:33:46.356744 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-9eb14adc-75ac-418f-8f5f-8638137eac09 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:33:46.360147 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-9eb14adc-75ac-418f-8f5f-8638137eac09 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] [instance: 3827385c-be20-4887-9735-0e5e54113151] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:33:46.499615 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-9eb14adc-75ac-418f-8f5f-8638137eac09 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f6c755dbf74640a372802f02733eb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f0473c6214a4428be438fabc530012b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:33:46.515273 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-9eb14adc-75ac-418f-8f5f-8638137eac09 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] 10.222.0.30 "GET /compute/v2.1/servers/3827385c-be20-4887-9735-0e5e54113151" status: 200 len: 1240 microversion: 2.1 time: 0.168706 Jun 16 18:33:46.516456 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 253/551] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:33:46 2022] GET /compute/v2.1/servers/3827385c-be20-4887-9735-0e5e54113151 => generated 1240 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:33:47.541922 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-82dd8c06-68ac-48a6-8f8c-02ccbec221f7 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:33:47.544237 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-82dd8c06-68ac-48a6-8f8c-02ccbec221f7 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] [instance: 3827385c-be20-4887-9735-0e5e54113151] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:33:47.555882 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-82dd8c06-68ac-48a6-8f8c-02ccbec221f7 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:47.557065 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-82dd8c06-68ac-48a6-8f8c-02ccbec221f7 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:47.558805 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-82dd8c06-68ac-48a6-8f8c-02ccbec221f7 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:47.559867 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-82dd8c06-68ac-48a6-8f8c-02ccbec221f7 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:47.691594 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-82dd8c06-68ac-48a6-8f8c-02ccbec221f7 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f6c755dbf74640a372802f02733eb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f0473c6214a4428be438fabc530012b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:33:47.721348 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-82dd8c06-68ac-48a6-8f8c-02ccbec221f7 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] 10.222.0.30 "GET /compute/v2.1/servers/3827385c-be20-4887-9735-0e5e54113151" status: 200 len: 1292 microversion: 2.1 time: 0.189846 Jun 16 18:33:47.723130 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 299/552] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:33:47 2022] GET /compute/v2.1/servers/3827385c-be20-4887-9735-0e5e54113151 => generated 1292 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:33:48.747128 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-182048f9-26bb-4929-b398-6575f9fcadc8 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:33:48.747827 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-182048f9-26bb-4929-b398-6575f9fcadc8 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] [instance: 3827385c-be20-4887-9735-0e5e54113151] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:33:48.761539 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-182048f9-26bb-4929-b398-6575f9fcadc8 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:48.762336 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-182048f9-26bb-4929-b398-6575f9fcadc8 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:48.763459 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-182048f9-26bb-4929-b398-6575f9fcadc8 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:48.764105 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-182048f9-26bb-4929-b398-6575f9fcadc8 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:49.111732 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-182048f9-26bb-4929-b398-6575f9fcadc8 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f6c755dbf74640a372802f02733eb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f0473c6214a4428be438fabc530012b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:33:49.144373 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-182048f9-26bb-4929-b398-6575f9fcadc8 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] 10.222.0.30 "GET /compute/v2.1/servers/3827385c-be20-4887-9735-0e5e54113151" status: 200 len: 1366 microversion: 2.1 time: 0.401278 Jun 16 18:33:49.145363 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 254/553] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:33:48 2022] GET /compute/v2.1/servers/3827385c-be20-4887-9735-0e5e54113151 => generated 1366 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:33:50.177734 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-c9f3aa0e-02e7-47ff-9318-9cc2e5d5b4dc tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:33:50.179886 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-c9f3aa0e-02e7-47ff-9318-9cc2e5d5b4dc tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] [instance: 3827385c-be20-4887-9735-0e5e54113151] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:33:50.199866 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-c9f3aa0e-02e7-47ff-9318-9cc2e5d5b4dc tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:50.207184 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-c9f3aa0e-02e7-47ff-9318-9cc2e5d5b4dc tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:50.218239 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-c9f3aa0e-02e7-47ff-9318-9cc2e5d5b4dc tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:50.219337 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-c9f3aa0e-02e7-47ff-9318-9cc2e5d5b4dc tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:50.472601 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [req-85804c6e-d989-4d0a-859b-c40a869ee26a req-706854c3-2bfc-4606-8d42-1a74bd3eab26 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3827385c-be20-4887-9735-0e5e54113151", "tag": "73b67cf2-c85d-4366-8b42-9ed862d569e5"}]} {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:33:50.510744 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [req-85804c6e-d989-4d0a-859b-c40a869ee26a req-706854c3-2bfc-4606-8d42-1a74bd3eab26 service nova] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:50.511292 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [req-85804c6e-d989-4d0a-859b-c40a869ee26a req-706854c3-2bfc-4606-8d42-1a74bd3eab26 service nova] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:50.548307 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.compute.server_external_events [req-85804c6e-d989-4d0a-859b-c40a869ee26a req-706854c3-2bfc-4606-8d42-1a74bd3eab26 service nova] Creating event network-changed:73b67cf2-c85d-4366-8b42-9ed862d569e5 for instance 3827385c-be20-4887-9735-0e5e54113151 on hv-cinder-81322 Jun 16 18:33:50.560469 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [req-85804c6e-d989-4d0a-859b-c40a869ee26a req-706854c3-2bfc-4606-8d42-1a74bd3eab26 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094287 Jun 16 18:33:50.561098 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 255/554] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Jun 16 18:33:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Jun 16 18:33:50.637239 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-c9f3aa0e-02e7-47ff-9318-9cc2e5d5b4dc tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f6c755dbf74640a372802f02733eb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f0473c6214a4428be438fabc530012b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:33:50.661632 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-c9f3aa0e-02e7-47ff-9318-9cc2e5d5b4dc tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] 10.222.0.30 "GET /compute/v2.1/servers/3827385c-be20-4887-9735-0e5e54113151" status: 200 len: 1366 microversion: 2.1 time: 0.490777 Jun 16 18:33:50.666317 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 300/555] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:33:50 2022] GET /compute/v2.1/servers/3827385c-be20-4887-9735-0e5e54113151 => generated 1366 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:33:51.696595 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-0d35a4d4-a69d-4656-88cd-24142e066888 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:33:51.697573 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-0d35a4d4-a69d-4656-88cd-24142e066888 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] [instance: 3827385c-be20-4887-9735-0e5e54113151] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:33:51.706141 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-0d35a4d4-a69d-4656-88cd-24142e066888 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:51.706668 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-0d35a4d4-a69d-4656-88cd-24142e066888 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:51.707597 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-0d35a4d4-a69d-4656-88cd-24142e066888 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:51.708094 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-0d35a4d4-a69d-4656-88cd-24142e066888 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:51.947028 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-0d35a4d4-a69d-4656-88cd-24142e066888 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f6c755dbf74640a372802f02733eb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f0473c6214a4428be438fabc530012b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:33:51.956478 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-0d35a4d4-a69d-4656-88cd-24142e066888 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] 10.222.0.30 "GET /compute/v2.1/servers/3827385c-be20-4887-9735-0e5e54113151" status: 200 len: 1366 microversion: 2.1 time: 0.266936 Jun 16 18:33:51.957179 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 256/556] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:33:51 2022] GET /compute/v2.1/servers/3827385c-be20-4887-9735-0e5e54113151 => generated 1366 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:33:52.993912 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-19ded82e-9783-4ef3-a14b-e18699f8a628 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:33:52.998146 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-19ded82e-9783-4ef3-a14b-e18699f8a628 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] [instance: 3827385c-be20-4887-9735-0e5e54113151] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:33:53.022407 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-19ded82e-9783-4ef3-a14b-e18699f8a628 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:53.025343 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-19ded82e-9783-4ef3-a14b-e18699f8a628 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:53.039961 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-19ded82e-9783-4ef3-a14b-e18699f8a628 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:53.044025 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-19ded82e-9783-4ef3-a14b-e18699f8a628 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:53.318535 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-19ded82e-9783-4ef3-a14b-e18699f8a628 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f6c755dbf74640a372802f02733eb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f0473c6214a4428be438fabc530012b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:33:53.327389 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-19ded82e-9783-4ef3-a14b-e18699f8a628 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] 10.222.0.30 "GET /compute/v2.1/servers/3827385c-be20-4887-9735-0e5e54113151" status: 200 len: 1366 microversion: 2.1 time: 0.348621 Jun 16 18:33:53.337725 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 301/557] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:33:52 2022] GET /compute/v2.1/servers/3827385c-be20-4887-9735-0e5e54113151 => generated 1366 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:33:54.344783 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-0dcd71de-45c5-4233-b2ce-0da4d691e235 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:33:54.345401 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-0dcd71de-45c5-4233-b2ce-0da4d691e235 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] [instance: 3827385c-be20-4887-9735-0e5e54113151] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:33:54.353050 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-0dcd71de-45c5-4233-b2ce-0da4d691e235 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:54.353504 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-0dcd71de-45c5-4233-b2ce-0da4d691e235 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:54.354295 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-0dcd71de-45c5-4233-b2ce-0da4d691e235 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:54.354730 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-0dcd71de-45c5-4233-b2ce-0da4d691e235 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:54.575074 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-0dcd71de-45c5-4233-b2ce-0da4d691e235 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f6c755dbf74640a372802f02733eb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f0473c6214a4428be438fabc530012b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:33:54.591471 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-0dcd71de-45c5-4233-b2ce-0da4d691e235 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] 10.222.0.30 "GET /compute/v2.1/servers/3827385c-be20-4887-9735-0e5e54113151" status: 200 len: 1366 microversion: 2.1 time: 0.250089 Jun 16 18:33:54.592828 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 257/558] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:33:54 2022] GET /compute/v2.1/servers/3827385c-be20-4887-9735-0e5e54113151 => generated 1366 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:33:54.913907 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [req-54841bd3-c7d3-4d71-b288-520ebc7a1a06 req-85ac2d1a-e616-40b1-aa29-d397fb999baf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3827385c-be20-4887-9735-0e5e54113151", "name": "network-vif-plugged", "status": "completed", "tag": "73b67cf2-c85d-4366-8b42-9ed862d569e5"}]} {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:33:54.940149 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [req-54841bd3-c7d3-4d71-b288-520ebc7a1a06 req-85ac2d1a-e616-40b1-aa29-d397fb999baf service nova] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:54.941447 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [req-54841bd3-c7d3-4d71-b288-520ebc7a1a06 req-85ac2d1a-e616-40b1-aa29-d397fb999baf service nova] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:54.968140 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.compute.server_external_events [req-54841bd3-c7d3-4d71-b288-520ebc7a1a06 req-85ac2d1a-e616-40b1-aa29-d397fb999baf service nova] Creating event network-vif-plugged:73b67cf2-c85d-4366-8b42-9ed862d569e5 for instance 3827385c-be20-4887-9735-0e5e54113151 on hv-cinder-81322 Jun 16 18:33:54.977365 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [req-54841bd3-c7d3-4d71-b288-520ebc7a1a06 req-85ac2d1a-e616-40b1-aa29-d397fb999baf service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076516 Jun 16 18:33:54.978398 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 302/559] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Jun 16 18:33:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 18:33:55.623712 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-8695f406-3132-4480-87cf-7393ad511e82 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:33:55.624706 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-8695f406-3132-4480-87cf-7393ad511e82 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] [instance: 3827385c-be20-4887-9735-0e5e54113151] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:33:55.634970 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-8695f406-3132-4480-87cf-7393ad511e82 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:55.635706 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-8695f406-3132-4480-87cf-7393ad511e82 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:55.637319 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-8695f406-3132-4480-87cf-7393ad511e82 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:55.638065 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-8695f406-3132-4480-87cf-7393ad511e82 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:56.089353 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-8695f406-3132-4480-87cf-7393ad511e82 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f6c755dbf74640a372802f02733eb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f0473c6214a4428be438fabc530012b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:33:56.104791 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-8695f406-3132-4480-87cf-7393ad511e82 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] 10.222.0.30 "GET /compute/v2.1/servers/3827385c-be20-4887-9735-0e5e54113151" status: 200 len: 1366 microversion: 2.1 time: 0.487211 Jun 16 18:33:56.120665 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 258/560] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:33:55 2022] GET /compute/v2.1/servers/3827385c-be20-4887-9735-0e5e54113151 => generated 1366 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:33:57.131555 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG dbcounter [-] [117670] Writing DB stats nova_cell0:SELECT=2 {{(pid=117670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:33:57.132904 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG dbcounter [-] [117670] Writing DB stats nova_cell0:SELECT=6 {{(pid=117670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:33:57.137910 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-5056f0f0-a930-4a41-993d-16b659b0c044 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:33:57.138656 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-5056f0f0-a930-4a41-993d-16b659b0c044 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] [instance: 3827385c-be20-4887-9735-0e5e54113151] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:33:57.148615 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-5056f0f0-a930-4a41-993d-16b659b0c044 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:57.149134 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-5056f0f0-a930-4a41-993d-16b659b0c044 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:57.149956 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-5056f0f0-a930-4a41-993d-16b659b0c044 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:57.150390 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-5056f0f0-a930-4a41-993d-16b659b0c044 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:57.344309 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-5056f0f0-a930-4a41-993d-16b659b0c044 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f6c755dbf74640a372802f02733eb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f0473c6214a4428be438fabc530012b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:33:57.355003 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-5056f0f0-a930-4a41-993d-16b659b0c044 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] 10.222.0.30 "GET /compute/v2.1/servers/3827385c-be20-4887-9735-0e5e54113151" status: 200 len: 1555 microversion: 2.1 time: 0.225583 Jun 16 18:33:57.356325 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 303/561] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:33:57 2022] GET /compute/v2.1/servers/3827385c-be20-4887-9735-0e5e54113151 => generated 1555 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:33:57.386112 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-cfbac00d-62cb-4d4d-8953-0ff1f8d91c99 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:33:57.389064 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-cfbac00d-62cb-4d4d-8953-0ff1f8d91c99 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] [instance: 3827385c-be20-4887-9735-0e5e54113151] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:33:57.403597 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG dbcounter [-] [117671] Writing DB stats nova_cell0:SELECT=6 {{(pid=117671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:33:57.409518 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-cfbac00d-62cb-4d4d-8953-0ff1f8d91c99 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:57.410872 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-cfbac00d-62cb-4d4d-8953-0ff1f8d91c99 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:57.415186 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-cfbac00d-62cb-4d4d-8953-0ff1f8d91c99 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:57.415989 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-cfbac00d-62cb-4d4d-8953-0ff1f8d91c99 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:57.571809 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-cfbac00d-62cb-4d4d-8953-0ff1f8d91c99 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] 10.222.0.30 "GET /compute/v2.1/servers/3827385c-be20-4887-9735-0e5e54113151/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.192974 Jun 16 18:33:57.572838 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 259/562] 10.222.0.30 () {58 vars in 1274 bytes} [Thu Jun 16 18:33:57 2022] GET /compute/v2.1/servers/3827385c-be20-4887-9735-0e5e54113151/os-interface => generated 284 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:33:59.334029 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [req-cc733062-b651-4665-b363-a94ddf981839 req-12020efd-841f-489a-b3ac-471e7b8775a0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3827385c-be20-4887-9735-0e5e54113151", "tag": "73b67cf2-c85d-4366-8b42-9ed862d569e5"}]} {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:33:59.395921 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [req-cc733062-b651-4665-b363-a94ddf981839 req-12020efd-841f-489a-b3ac-471e7b8775a0 service nova] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:59.413468 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [req-cc733062-b651-4665-b363-a94ddf981839 req-12020efd-841f-489a-b3ac-471e7b8775a0 service nova] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:59.482841 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.compute.server_external_events [req-cc733062-b651-4665-b363-a94ddf981839 req-12020efd-841f-489a-b3ac-471e7b8775a0 service nova] Creating event network-changed:73b67cf2-c85d-4366-8b42-9ed862d569e5 for instance 3827385c-be20-4887-9735-0e5e54113151 on hv-cinder-81322 Jun 16 18:33:59.493347 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-3ad067e3-8c4d-4d24-b48b-a1b76e1c831e tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:33:59.498105 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [req-cc733062-b651-4665-b363-a94ddf981839 req-12020efd-841f-489a-b3ac-471e7b8775a0 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.178407 Jun 16 18:33:59.500698 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 304/563] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Jun 16 18:33:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:33:59.516879 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-3ad067e3-8c4d-4d24-b48b-a1b76e1c831e tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] [instance: e10b3f49-1ff3-474c-833b-b83e3300e617] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:33:59.555733 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-3ad067e3-8c4d-4d24-b48b-a1b76e1c831e tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:59.557516 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-3ad067e3-8c4d-4d24-b48b-a1b76e1c831e tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:59.560148 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-3ad067e3-8c4d-4d24-b48b-a1b76e1c831e tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:33:59.561117 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-3ad067e3-8c4d-4d24-b48b-a1b76e1c831e tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:33:59.781091 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.objects.instance [None req-3ad067e3-8c4d-4d24-b48b-a1b76e1c831e tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lazy-loading 'services' on Instance uuid e10b3f49-1ff3-474c-833b-b83e3300e617 {{(pid=117671) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 18:34:00.010321 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-3ad067e3-8c4d-4d24-b48b-a1b76e1c831e tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] 10.222.0.30 "DELETE /compute/v2.1/servers/e10b3f49-1ff3-474c-833b-b83e3300e617/os-volume_attachments/648254df-1f60-4427-b3e6-4d4fcf115c5f" status: 202 len: 0 microversion: 2.1 time: 0.524838 Jun 16 18:34:00.012584 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 260/564] 10.222.0.30 () {58 vars in 1415 bytes} [Thu Jun 16 18:33:59 2022] DELETE /compute/v2.1/servers/e10b3f49-1ff3-474c-833b-b83e3300e617/os-volume_attachments/648254df-1f60-4427-b3e6-4d4fcf115c5f => generated 0 bytes in 529 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 16 18:34:00.031083 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-db0fbdca-28dc-4dbf-8144-759622bc5daf tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:34:00.033754 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-db0fbdca-28dc-4dbf-8144-759622bc5daf tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] [instance: e10b3f49-1ff3-474c-833b-b83e3300e617] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:34:00.052548 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-db0fbdca-28dc-4dbf-8144-759622bc5daf tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:00.069389 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-db0fbdca-28dc-4dbf-8144-759622bc5daf tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:00.075403 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-db0fbdca-28dc-4dbf-8144-759622bc5daf tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:00.080951 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-db0fbdca-28dc-4dbf-8144-759622bc5daf tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:00.141598 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-db0fbdca-28dc-4dbf-8144-759622bc5daf tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] 10.222.0.30 "GET /compute/v2.1/servers/e10b3f49-1ff3-474c-833b-b83e3300e617/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.121276 Jun 16 18:34:00.142962 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 305/565] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Jun 16 18:34:00 2022] GET /compute/v2.1/servers/e10b3f49-1ff3-474c-833b-b83e3300e617/os-volume_attachments => generated 197 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:34:01.166702 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-ba6d3302-f36b-4c38-ba06-6761481fdbda tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:34:01.171658 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-ba6d3302-f36b-4c38-ba06-6761481fdbda tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] [instance: e10b3f49-1ff3-474c-833b-b83e3300e617] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:34:01.188527 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-ba6d3302-f36b-4c38-ba06-6761481fdbda tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:01.188981 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-ba6d3302-f36b-4c38-ba06-6761481fdbda tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:01.189778 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-ba6d3302-f36b-4c38-ba06-6761481fdbda tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:01.190216 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-ba6d3302-f36b-4c38-ba06-6761481fdbda tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:01.260422 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-ba6d3302-f36b-4c38-ba06-6761481fdbda tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] 10.222.0.30 "GET /compute/v2.1/servers/e10b3f49-1ff3-474c-833b-b83e3300e617/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.108575 Jun 16 18:34:01.262263 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 261/566] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Jun 16 18:34:01 2022] GET /compute/v2.1/servers/e10b3f49-1ff3-474c-833b-b83e3300e617/os-volume_attachments => generated 25 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 16 18:34:01.395113 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-ef37fc6f-67ff-4e74-9322-f451fcdbe6fd tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:34:01.395643 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-ef37fc6f-67ff-4e74-9322-f451fcdbe6fd tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] [instance: e10b3f49-1ff3-474c-833b-b83e3300e617] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:34:01.407918 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-ef37fc6f-67ff-4e74-9322-f451fcdbe6fd tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:01.410100 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-ef37fc6f-67ff-4e74-9322-f451fcdbe6fd tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:01.411121 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-ef37fc6f-67ff-4e74-9322-f451fcdbe6fd tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:01.411691 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-ef37fc6f-67ff-4e74-9322-f451fcdbe6fd tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:01.496523 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG dbcounter [-] [117671] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=117671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:34:01.518227 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-ef37fc6f-67ff-4e74-9322-f451fcdbe6fd tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] [instance: e10b3f49-1ff3-474c-833b-b83e3300e617] Going to try to terminate instance {{(pid=117671) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 18:34:01.578487 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-5c4d9e2f-db25-42f0-9ddc-c0d0e2156dde tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:34:01.579803 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-5c4d9e2f-db25-42f0-9ddc-c0d0e2156dde tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] [instance: 16226ccb-8bc4-43b6-abd5-7601be0e57b5] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:34:01.593551 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-5c4d9e2f-db25-42f0-9ddc-c0d0e2156dde tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:01.600386 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-5c4d9e2f-db25-42f0-9ddc-c0d0e2156dde tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:01.601998 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-5c4d9e2f-db25-42f0-9ddc-c0d0e2156dde tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:01.602742 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-5c4d9e2f-db25-42f0-9ddc-c0d0e2156dde tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:01.712865 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-5c4d9e2f-db25-42f0-9ddc-c0d0e2156dde tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] 10.222.0.30 "GET /compute/v2.1/servers/16226ccb-8bc4-43b6-abd5-7601be0e57b5/ips" status: 200 len: 151 microversion: 2.20 time: 0.475797 Jun 16 18:34:01.715801 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 306/567] 10.222.0.30 () {60 vars in 1288 bytes} [Thu Jun 16 18:34:01 2022] GET /compute/v2.1/servers/16226ccb-8bc4-43b6-abd5-7601be0e57b5/ips => generated 151 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 18:34:01.738518 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-ef37fc6f-67ff-4e74-9322-f451fcdbe6fd tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] 10.222.0.30 "DELETE /compute/v2.1/servers/e10b3f49-1ff3-474c-833b-b83e3300e617" status: 204 len: 0 microversion: 2.1 time: 0.345188 Jun 16 18:34:01.741276 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 262/568] 10.222.0.30 () {58 vars in 1238 bytes} [Thu Jun 16 18:34:01 2022] DELETE /compute/v2.1/servers/e10b3f49-1ff3-474c-833b-b83e3300e617 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 16 18:34:01.751452 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-1899077e-7cb1-43fb-b736-479a93cde7a1 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:34:01.752541 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-1899077e-7cb1-43fb-b736-479a93cde7a1 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] [instance: e10b3f49-1ff3-474c-833b-b83e3300e617] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:34:01.766366 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-1899077e-7cb1-43fb-b736-479a93cde7a1 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:01.767577 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-1899077e-7cb1-43fb-b736-479a93cde7a1 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:01.771314 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-1899077e-7cb1-43fb-b736-479a93cde7a1 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:01.772605 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-1899077e-7cb1-43fb-b736-479a93cde7a1 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:01.822125 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG dbcounter [-] [117670] Writing DB stats nova_cell1:INSERT=2,nova_cell1:SELECT=97,nova_cell1:UPDATE=1 {{(pid=117670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:34:02.077881 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-1899077e-7cb1-43fb-b736-479a93cde7a1 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512f01cca14b447c8f6c9eebbd828eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70bbccf07e3404cb94ba59201061a6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:34:02.096636 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-1899077e-7cb1-43fb-b736-479a93cde7a1 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] 10.222.0.30 "GET /compute/v2.1/servers/e10b3f49-1ff3-474c-833b-b83e3300e617" status: 200 len: 1690 microversion: 2.1 time: 0.350435 Jun 16 18:34:02.099510 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 307/569] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:34:01 2022] GET /compute/v2.1/servers/e10b3f49-1ff3-474c-833b-b83e3300e617 => generated 1690 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:34:03.124650 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-ca405f67-aa2d-4982-98bf-e5f23d789d37 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:34:03.127432 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-ca405f67-aa2d-4982-98bf-e5f23d789d37 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] [instance: e10b3f49-1ff3-474c-833b-b83e3300e617] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:34:03.136405 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG dbcounter [-] [117671] Writing DB stats nova_api:SELECT=71,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=117671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:34:03.149210 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-ca405f67-aa2d-4982-98bf-e5f23d789d37 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:03.150271 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-ca405f67-aa2d-4982-98bf-e5f23d789d37 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:03.151945 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-ca405f67-aa2d-4982-98bf-e5f23d789d37 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:03.153268 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-ca405f67-aa2d-4982-98bf-e5f23d789d37 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:03.585023 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-ca405f67-aa2d-4982-98bf-e5f23d789d37 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512f01cca14b447c8f6c9eebbd828eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70bbccf07e3404cb94ba59201061a6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:34:03.600839 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-ca405f67-aa2d-4982-98bf-e5f23d789d37 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] 10.222.0.30 "GET /compute/v2.1/servers/e10b3f49-1ff3-474c-833b-b83e3300e617" status: 200 len: 1690 microversion: 2.1 time: 0.483557 Jun 16 18:34:03.601944 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 263/570] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:34:03 2022] GET /compute/v2.1/servers/e10b3f49-1ff3-474c-833b-b83e3300e617 => generated 1690 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:34:03.935913 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-8e7c22eb-76bd-4407-982e-7063af64206c tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:34:03.937990 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-8e7c22eb-76bd-4407-982e-7063af64206c tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] [instance: 16226ccb-8bc4-43b6-abd5-7601be0e57b5] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:34:03.952746 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-8e7c22eb-76bd-4407-982e-7063af64206c tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:03.954039 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-8e7c22eb-76bd-4407-982e-7063af64206c tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:03.955780 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-8e7c22eb-76bd-4407-982e-7063af64206c tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:03.957472 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-8e7c22eb-76bd-4407-982e-7063af64206c tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:04.007854 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.objects.instance [None req-8e7c22eb-76bd-4407-982e-7063af64206c tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lazy-loading 'flavor' on Instance uuid 16226ccb-8bc4-43b6-abd5-7601be0e57b5 {{(pid=117670) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 18:34:04.575730 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-8e7c22eb-76bd-4407-982e-7063af64206c tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] 10.222.0.30 "POST /compute/v2.1/servers/16226ccb-8bc4-43b6-abd5-7601be0e57b5/action" status: 202 len: 0 microversion: 2.20 time: 0.647473 Jun 16 18:34:04.576938 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 308/571] 10.222.0.30 () {62 vars in 1318 bytes} [Thu Jun 16 18:34:03 2022] POST /compute/v2.1/servers/16226ccb-8bc4-43b6-abd5-7601be0e57b5/action => generated 0 bytes in 652 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 16 18:34:04.590759 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-3eb8cb51-c857-4bce-bf8a-b05fd5aae38f tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:34:04.593144 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-3eb8cb51-c857-4bce-bf8a-b05fd5aae38f tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] [instance: 16226ccb-8bc4-43b6-abd5-7601be0e57b5] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:34:04.608336 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-3eb8cb51-c857-4bce-bf8a-b05fd5aae38f tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:04.609334 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-3eb8cb51-c857-4bce-bf8a-b05fd5aae38f tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:04.610819 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-3eb8cb51-c857-4bce-bf8a-b05fd5aae38f tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:04.611608 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-3eb8cb51-c857-4bce-bf8a-b05fd5aae38f tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:04.633607 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-e9aaa59a-53ce-4783-9228-599a03987e06 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:34:04.635940 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-e9aaa59a-53ce-4783-9228-599a03987e06 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] [instance: e10b3f49-1ff3-474c-833b-b83e3300e617] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:34:04.653340 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-e9aaa59a-53ce-4783-9228-599a03987e06 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:04.654755 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-e9aaa59a-53ce-4783-9228-599a03987e06 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:04.656527 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-e9aaa59a-53ce-4783-9228-599a03987e06 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:04.657896 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-e9aaa59a-53ce-4783-9228-599a03987e06 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:04.854318 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-3eb8cb51-c857-4bce-bf8a-b05fd5aae38f tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:34:04.868481 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-3eb8cb51-c857-4bce-bf8a-b05fd5aae38f tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:34:04.870867 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-3eb8cb51-c857-4bce-bf8a-b05fd5aae38f tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:34:04.872830 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-3eb8cb51-c857-4bce-bf8a-b05fd5aae38f tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] 10.222.0.30 "GET /compute/v2.1/servers/16226ccb-8bc4-43b6-abd5-7601be0e57b5" status: 200 len: 1721 microversion: 2.20 time: 0.290261 Jun 16 18:34:04.887639 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 264/572] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Jun 16 18:34:04 2022] GET /compute/v2.1/servers/16226ccb-8bc4-43b6-abd5-7601be0e57b5 => generated 1721 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:34:05.326663 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-e9aaa59a-53ce-4783-9228-599a03987e06 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512f01cca14b447c8f6c9eebbd828eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70bbccf07e3404cb94ba59201061a6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:34:05.340944 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-e9aaa59a-53ce-4783-9228-599a03987e06 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] 10.222.0.30 "GET /compute/v2.1/servers/e10b3f49-1ff3-474c-833b-b83e3300e617" status: 200 len: 1690 microversion: 2.1 time: 0.718184 Jun 16 18:34:05.356624 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 309/573] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:34:04 2022] GET /compute/v2.1/servers/e10b3f49-1ff3-474c-833b-b83e3300e617 => generated 1690 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:34:05.895813 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-3d8ef81b-cd23-49b9-a7ab-6790ee879eda tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:34:05.899770 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-3d8ef81b-cd23-49b9-a7ab-6790ee879eda tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] [instance: 16226ccb-8bc4-43b6-abd5-7601be0e57b5] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:34:05.909309 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-3d8ef81b-cd23-49b9-a7ab-6790ee879eda tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:05.910096 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-3d8ef81b-cd23-49b9-a7ab-6790ee879eda tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:05.911307 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-3d8ef81b-cd23-49b9-a7ab-6790ee879eda tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:05.912931 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-3d8ef81b-cd23-49b9-a7ab-6790ee879eda tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:06.302271 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-3d8ef81b-cd23-49b9-a7ab-6790ee879eda tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:34:06.340663 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-3d8ef81b-cd23-49b9-a7ab-6790ee879eda tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:34:06.343815 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-3d8ef81b-cd23-49b9-a7ab-6790ee879eda tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:34:06.358060 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-3d8ef81b-cd23-49b9-a7ab-6790ee879eda tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] 10.222.0.30 "GET /compute/v2.1/servers/16226ccb-8bc4-43b6-abd5-7601be0e57b5" status: 200 len: 1721 microversion: 2.20 time: 0.461175 Jun 16 18:34:06.359634 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 265/574] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Jun 16 18:34:05 2022] GET /compute/v2.1/servers/16226ccb-8bc4-43b6-abd5-7601be0e57b5 => generated 1721 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 18:34:06.372221 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-eb129ca0-147e-4dfb-a68c-b486c2f2abb4 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:34:06.373732 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-eb129ca0-147e-4dfb-a68c-b486c2f2abb4 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] [instance: e10b3f49-1ff3-474c-833b-b83e3300e617] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:34:06.390502 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-eb129ca0-147e-4dfb-a68c-b486c2f2abb4 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:06.391109 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-eb129ca0-147e-4dfb-a68c-b486c2f2abb4 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:06.395431 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-eb129ca0-147e-4dfb-a68c-b486c2f2abb4 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:06.396263 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-eb129ca0-147e-4dfb-a68c-b486c2f2abb4 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:06.614728 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-eb129ca0-147e-4dfb-a68c-b486c2f2abb4 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512f01cca14b447c8f6c9eebbd828eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70bbccf07e3404cb94ba59201061a6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:34:06.644724 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-eb129ca0-147e-4dfb-a68c-b486c2f2abb4 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] 10.222.0.30 "GET /compute/v2.1/servers/e10b3f49-1ff3-474c-833b-b83e3300e617" status: 200 len: 1623 microversion: 2.1 time: 0.274281 Jun 16 18:34:06.667485 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 310/575] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:34:06 2022] GET /compute/v2.1/servers/e10b3f49-1ff3-474c-833b-b83e3300e617 => generated 1623 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:34:07.016085 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [req-22d77d3b-2b39-404f-aca9-b77b324688ed req-b37488aa-eb50-487b-8a8d-3e5d8cede6f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e10b3f49-1ff3-474c-833b-b83e3300e617", "name": "network-vif-deleted", "tag": "415b1820-aec4-49ee-8ec3-7e34692c9dc5"}]} {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:34:07.043182 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [req-22d77d3b-2b39-404f-aca9-b77b324688ed req-b37488aa-eb50-487b-8a8d-3e5d8cede6f3 service nova] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:07.044197 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [req-22d77d3b-2b39-404f-aca9-b77b324688ed req-b37488aa-eb50-487b-8a8d-3e5d8cede6f3 service nova] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:07.069351 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.compute.server_external_events [req-22d77d3b-2b39-404f-aca9-b77b324688ed req-b37488aa-eb50-487b-8a8d-3e5d8cede6f3 service nova] Creating event network-vif-deleted:415b1820-aec4-49ee-8ec3-7e34692c9dc5 for instance e10b3f49-1ff3-474c-833b-b83e3300e617 on hv-cinder-81322 Jun 16 18:34:07.093436 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [req-22d77d3b-2b39-404f-aca9-b77b324688ed req-b37488aa-eb50-487b-8a8d-3e5d8cede6f3 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081386 Jun 16 18:34:07.096669 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 266/576] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Jun 16 18:34:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 18:34:07.381524 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-44a06936-9b47-4af1-bd4f-bb081326b0ec tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:34:07.382152 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-44a06936-9b47-4af1-bd4f-bb081326b0ec tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] [instance: 16226ccb-8bc4-43b6-abd5-7601be0e57b5] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:34:07.389018 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG dbcounter [-] [117670] Writing DB stats nova_api:SELECT=57,nova_api:DELETE=2,nova_api:INSERT=3 {{(pid=117670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:34:07.391821 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-44a06936-9b47-4af1-bd4f-bb081326b0ec tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:07.393144 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-44a06936-9b47-4af1-bd4f-bb081326b0ec tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:07.394224 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-44a06936-9b47-4af1-bd4f-bb081326b0ec tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:07.394863 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-44a06936-9b47-4af1-bd4f-bb081326b0ec tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:07.695592 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-0c49b1e4-047e-47e8-a3fd-a1fdbf152791 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:34:07.697221 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-0c49b1e4-047e-47e8-a3fd-a1fdbf152791 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] [instance: e10b3f49-1ff3-474c-833b-b83e3300e617] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:34:07.737180 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-0c49b1e4-047e-47e8-a3fd-a1fdbf152791 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:07.738327 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-0c49b1e4-047e-47e8-a3fd-a1fdbf152791 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:07.741734 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-0c49b1e4-047e-47e8-a3fd-a1fdbf152791 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:07.743241 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-0c49b1e4-047e-47e8-a3fd-a1fdbf152791 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:07.776728 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-44a06936-9b47-4af1-bd4f-bb081326b0ec tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:34:07.806506 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.wsgi [None req-0c49b1e4-047e-47e8-a3fd-a1fdbf152791 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] HTTP exception thrown: Instance e10b3f49-1ff3-474c-833b-b83e3300e617 could not be found. Jun 16 18:34:07.810947 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-0c49b1e4-047e-47e8-a3fd-a1fdbf152791 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Request method failure captured: Jun 16 18:34:07.810947 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: request: GET /compute/v2.1/servers/e10b3f49-1ff3-474c-833b-b83e3300e617 HTTP/1.1 Jun 16 18:34:07.810947 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: Accept: application/json Jun 16 18:34:07.810947 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: Accept-Encoding: identity Jun 16 18:34:07.810947 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: Connection: close Jun 16 18:34:07.810947 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: Content-Length: 0 Jun 16 18:34:07.810947 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: Content-Type: application/json Jun 16 18:34:07.810947 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: Host: 10.222.0.30 Jun 16 18:34:07.810947 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: Openstack-System-Scope: None Jun 16 18:34:07.810947 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: User-Agent: python-urllib3/1.26.9 Jun 16 18:34:07.810947 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Auth-Token: gAAAAABiq3ZeOWVXrcHoFQenWS7gEz2AmLT0pk9WALQKP9rY-D8or65AIFivXjSOMGuT5nkfTCPX-UgC2J78DfMkn6N1K-iY82TmKX61g47gNVuWG9jlnvzIzdHnPvexbz1CwR9za6ZIAFnBpf6Y_L3GTnzg7Lzmn3ZLTYDBiHKMrCwhKJPoGQI Jun 16 18:34:07.810947 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Domain-Id: None Jun 16 18:34:07.810947 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Domain-Name: None Jun 16 18:34:07.810947 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Identity-Status: Confirmed Jun 16 18:34:07.810947 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Is-Admin-Project: True Jun 16 18:34:07.810947 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Project-Domain-Id: default Jun 16 18:34:07.810947 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Project-Domain-Name: Default Jun 16 18:34:07.810947 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Project-Id: b70bbccf07e3404cb94ba59201061a6a Jun 16 18:34:07.810947 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1891572618 Jun 16 18:34:07.810947 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Role: reader,member Jun 16 18:34:07.810947 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Roles: reader,member Jun 16 18:34:07.814004 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/b70bbccf07e3404cb94ba59201061a6a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/b70bbccf07e3404cb94ba59201061a6a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_b70bbccf07e3404cb94ba59201061a6a", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/b70bbccf07e3404cb94ba59201061a6a"}]}] Jun 16 18:34:07.814004 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1891572618 Jun 16 18:34:07.814004 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Tenant-Id: b70bbccf07e3404cb94ba59201061a6a Jun 16 18:34:07.814004 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1891572618 Jun 16 18:34:07.814004 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-User: tempest-ServerRescueNegativeTestJSON-1891572618-project Jun 16 18:34:07.814004 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-User-Domain-Id: default Jun 16 18:34:07.814004 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-User-Domain-Name: Default Jun 16 18:34:07.814004 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-User-Id: 512f01cca14b447c8f6c9eebbd828eb2 Jun 16 18:34:07.814004 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1891572618-project Jun 16 18:34:07.814004 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: method: > Jun 16 18:34:07.814004 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: exception: Instance e10b3f49-1ff3-474c-833b-b83e3300e617 could not be found. Jun 16 18:34:07.814004 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: action_args: {'id': 'e10b3f49-1ff3-474c-833b-b83e3300e617'} Jun 16 18:34:07.815565 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:34:07.815565 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:34:07.815565 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 18:34:07.815565 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 18:34:07.815565 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 18:34:07.815565 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 18:34:07.815565 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 18:34:07.815565 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 18:34:07.815565 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 18:34:07.815565 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 18:34:07.815565 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e10b3f49-1ff3-474c-833b-b83e3300e617 could not be found. Jun 16 18:34:07.815565 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Jun 16 18:34:07.815565 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:34:07.815565 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Jun 16 18:34:07.815565 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:34:07.815565 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:34:07.815565 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:34:07.815565 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:34:07.815565 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:34:07.815565 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:34:07.820206 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:34:07.820206 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 18:34:07.820206 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 18:34:07.820206 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 18:34:07.820206 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 18:34:07.820206 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 18:34:07.820206 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:34:07.820206 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e10b3f49-1ff3-474c-833b-b83e3300e617 could not be found. Jun 16 18:34:07.820206 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Jun 16 18:34:07.820206 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:34:07.820206 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Jun 16 18:34:07.820206 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:34:07.820206 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:34:07.820206 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:34:07.820206 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:34:07.820206 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:34:07.820206 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e10b3f49-1ff3-474c-833b-b83e3300e617 could not be found. Jun 16 18:34:07.820206 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Jun 16 18:34:07.823380 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-44a06936-9b47-4af1-bd4f-bb081326b0ec tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:34:07.826091 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-44a06936-9b47-4af1-bd4f-bb081326b0ec tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:34:07.828733 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-44a06936-9b47-4af1-bd4f-bb081326b0ec tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] 10.222.0.30 "GET /compute/v2.1/servers/16226ccb-8bc4-43b6-abd5-7601be0e57b5" status: 200 len: 1721 microversion: 2.20 time: 0.451540 Jun 16 18:34:07.830501 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 311/577] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Jun 16 18:34:07 2022] GET /compute/v2.1/servers/16226ccb-8bc4-43b6-abd5-7601be0e57b5 => generated 1721 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:34:07.841339 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-0c49b1e4-047e-47e8-a3fd-a1fdbf152791 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Returning 404 to user: Instance e10b3f49-1ff3-474c-833b-b83e3300e617 could not be found. {{(pid=117671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:34:07.845520 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-0c49b1e4-047e-47e8-a3fd-a1fdbf152791 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] 10.222.0.30 "GET /compute/v2.1/servers/e10b3f49-1ff3-474c-833b-b83e3300e617" status: 404 len: 111 microversion: 2.1 time: 0.183553 Jun 16 18:34:07.856347 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 267/578] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:34:07 2022] GET /compute/v2.1/servers/e10b3f49-1ff3-474c-833b-b83e3300e617 => generated 111 bytes in 193 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 16 18:34:07.868164 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-cc600ea8-88b6-4e27-b41f-0d0d478006a8 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Calling method '.version_select at 0x7fbb34740700>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:34:07.917104 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-cc600ea8-88b6-4e27-b41f-0d0d478006a8 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1111354642" status: 202 len: 0 microversion: 2.1 time: 0.054441 Jun 16 18:34:07.923282 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 312/579] 10.222.0.30 () {58 vars in 1220 bytes} [Thu Jun 16 18:34:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1111354642 => generated 0 bytes in 61 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 18:34:08.862743 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-dffef881-1c68-48b5-9ee4-b038cb9e7785 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:34:08.863981 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-dffef881-1c68-48b5-9ee4-b038cb9e7785 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] [instance: 16226ccb-8bc4-43b6-abd5-7601be0e57b5] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:34:08.875164 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-dffef881-1c68-48b5-9ee4-b038cb9e7785 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:08.875980 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-dffef881-1c68-48b5-9ee4-b038cb9e7785 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:08.879049 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-dffef881-1c68-48b5-9ee4-b038cb9e7785 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:08.879830 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-dffef881-1c68-48b5-9ee4-b038cb9e7785 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:09.298877 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-dffef881-1c68-48b5-9ee4-b038cb9e7785 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:34:09.328896 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-dffef881-1c68-48b5-9ee4-b038cb9e7785 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:34:09.337240 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-dffef881-1c68-48b5-9ee4-b038cb9e7785 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:34:09.345787 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-dffef881-1c68-48b5-9ee4-b038cb9e7785 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] 10.222.0.30 "GET /compute/v2.1/servers/16226ccb-8bc4-43b6-abd5-7601be0e57b5" status: 200 len: 1721 microversion: 2.20 time: 0.491115 Jun 16 18:34:09.352078 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 268/580] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Jun 16 18:34:08 2022] GET /compute/v2.1/servers/16226ccb-8bc4-43b6-abd5-7601be0e57b5 => generated 1721 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:34:10.371885 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-5b1deb1a-bcd4-48b2-af2f-c433f5d7cf8b tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:34:10.372891 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-5b1deb1a-bcd4-48b2-af2f-c433f5d7cf8b tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] [instance: 16226ccb-8bc4-43b6-abd5-7601be0e57b5] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:34:10.383471 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-5b1deb1a-bcd4-48b2-af2f-c433f5d7cf8b tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:10.384231 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-5b1deb1a-bcd4-48b2-af2f-c433f5d7cf8b tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:10.385170 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-5b1deb1a-bcd4-48b2-af2f-c433f5d7cf8b tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:10.385934 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-5b1deb1a-bcd4-48b2-af2f-c433f5d7cf8b tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:10.593767 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-5b1deb1a-bcd4-48b2-af2f-c433f5d7cf8b tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:34:10.604661 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-5b1deb1a-bcd4-48b2-af2f-c433f5d7cf8b tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:34:10.606594 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-5b1deb1a-bcd4-48b2-af2f-c433f5d7cf8b tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:34:10.607904 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-5b1deb1a-bcd4-48b2-af2f-c433f5d7cf8b tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] 10.222.0.30 "GET /compute/v2.1/servers/16226ccb-8bc4-43b6-abd5-7601be0e57b5" status: 200 len: 1721 microversion: 2.20 time: 0.243843 Jun 16 18:34:10.608593 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 313/581] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Jun 16 18:34:10 2022] GET /compute/v2.1/servers/16226ccb-8bc4-43b6-abd5-7601be0e57b5 => generated 1721 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:34:11.639566 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-ca17860a-fabd-4a48-bfcb-c4fa05443259 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:34:11.640723 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-ca17860a-fabd-4a48-bfcb-c4fa05443259 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] [instance: 16226ccb-8bc4-43b6-abd5-7601be0e57b5] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:34:11.652515 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-ca17860a-fabd-4a48-bfcb-c4fa05443259 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:11.653267 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-ca17860a-fabd-4a48-bfcb-c4fa05443259 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:11.654394 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-ca17860a-fabd-4a48-bfcb-c4fa05443259 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:11.655105 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-ca17860a-fabd-4a48-bfcb-c4fa05443259 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:11.747954 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-f51acf3f-e86d-4829-a2fb-ca9f9916b6eb tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Action: 'create', calling method: .version_select at 0x7fbb23f5c430>, body: {"keypair": {"name": "tempest-TestShelveInstance-1758465465", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCRQ2P+tDpiTfj6iyptiy7tnl2NeapVbY6U7+9Y9ZOOtvghNtc+i4go81jRF6Q9ApFML3sksGL54lHWf6JfHOmFKoVg7R+cagEWjjIKd6UkYKW0rD3hET1d73eNl8jgdTw=="}} {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:34:11.775170 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.quota [None req-f51acf3f-e86d-4829-a2fb-ca9f9916b6eb tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Getting quotas for project 4d9f254f568e4bd98b2e4087c3a32c04. Resources: {'key_pairs'} {{(pid=117671) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 18:34:11.783238 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.quota [None req-f51acf3f-e86d-4829-a2fb-ca9f9916b6eb tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Getting quotas for user 0cc31f4b39704173858410ae52ac2c66 and project 4d9f254f568e4bd98b2e4087c3a32c04. Resources: {'key_pairs'} {{(pid=117671) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 18:34:11.823418 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-f51acf3f-e86d-4829-a2fb-ca9f9916b6eb tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.345384 Jun 16 18:34:11.824191 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 269/582] 10.222.0.30 () {60 vars in 1158 bytes} [Thu Jun 16 18:34:11 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:34:11.895058 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-ca17860a-fabd-4a48-bfcb-c4fa05443259 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:34:11.906502 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-ca17860a-fabd-4a48-bfcb-c4fa05443259 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:34:11.908286 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-ca17860a-fabd-4a48-bfcb-c4fa05443259 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:34:11.909541 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-ca17860a-fabd-4a48-bfcb-c4fa05443259 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] 10.222.0.30 "GET /compute/v2.1/servers/16226ccb-8bc4-43b6-abd5-7601be0e57b5" status: 200 len: 1721 microversion: 2.20 time: 0.276665 Jun 16 18:34:11.910162 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 314/583] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Jun 16 18:34:11 2022] GET /compute/v2.1/servers/16226ccb-8bc4-43b6-abd5-7601be0e57b5 => generated 1721 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 18:34:12.097402 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-dd66f372-ed48-4a39-a8ac-2d53dbf48853 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:34:12.098259 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-dd66f372-ed48-4a39-a8ac-2d53dbf48853 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] [instance: 05981bed-b625-4e9a-b860-6a7ce1288e8d] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:34:12.108280 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-dd66f372-ed48-4a39-a8ac-2d53dbf48853 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:12.109011 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-dd66f372-ed48-4a39-a8ac-2d53dbf48853 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:12.110033 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-dd66f372-ed48-4a39-a8ac-2d53dbf48853 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:12.110584 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-dd66f372-ed48-4a39-a8ac-2d53dbf48853 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:12.144633 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-dd66f372-ed48-4a39-a8ac-2d53dbf48853 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] [instance: 05981bed-b625-4e9a-b860-6a7ce1288e8d] Going to try to terminate instance {{(pid=117671) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 18:34:12.286388 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-dd66f372-ed48-4a39-a8ac-2d53dbf48853 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] 10.222.0.30 "DELETE /compute/v2.1/servers/05981bed-b625-4e9a-b860-6a7ce1288e8d" status: 204 len: 0 microversion: 2.1 time: 0.195672 Jun 16 18:34:12.287947 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 270/584] 10.222.0.30 () {58 vars in 1238 bytes} [Thu Jun 16 18:34:12 2022] DELETE /compute/v2.1/servers/05981bed-b625-4e9a-b860-6a7ce1288e8d => generated 0 bytes in 199 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 18:34:12.298141 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-1ab01796-21d1-4205-98fb-3d7782fa574b tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:34:12.299072 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-1ab01796-21d1-4205-98fb-3d7782fa574b tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] [instance: 05981bed-b625-4e9a-b860-6a7ce1288e8d] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:34:12.309442 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-1ab01796-21d1-4205-98fb-3d7782fa574b tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:12.312452 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-1ab01796-21d1-4205-98fb-3d7782fa574b tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:12.313915 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-1ab01796-21d1-4205-98fb-3d7782fa574b tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:12.314683 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-1ab01796-21d1-4205-98fb-3d7782fa574b tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:12.569857 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-1ab01796-21d1-4205-98fb-3d7782fa574b tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512f01cca14b447c8f6c9eebbd828eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70bbccf07e3404cb94ba59201061a6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:34:12.592255 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-1ab01796-21d1-4205-98fb-3d7782fa574b tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] 10.222.0.30 "GET /compute/v2.1/servers/05981bed-b625-4e9a-b860-6a7ce1288e8d" status: 200 len: 1508 microversion: 2.1 time: 0.297789 Jun 16 18:34:12.598288 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 315/585] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:34:12 2022] GET /compute/v2.1/servers/05981bed-b625-4e9a-b860-6a7ce1288e8d => generated 1508 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:34:12.931945 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-9b9a0715-b758-4e1b-be47-b13091c43617 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:34:12.933219 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-9b9a0715-b758-4e1b-be47-b13091c43617 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] [instance: 16226ccb-8bc4-43b6-abd5-7601be0e57b5] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:34:12.941718 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-9b9a0715-b758-4e1b-be47-b13091c43617 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:12.942441 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-9b9a0715-b758-4e1b-be47-b13091c43617 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:12.944174 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-9b9a0715-b758-4e1b-be47-b13091c43617 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:12.944859 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-9b9a0715-b758-4e1b-be47-b13091c43617 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:13.147183 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-9b9a0715-b758-4e1b-be47-b13091c43617 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:34:13.165938 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-9b9a0715-b758-4e1b-be47-b13091c43617 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:34:13.169771 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-9b9a0715-b758-4e1b-be47-b13091c43617 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:34:13.172752 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-9b9a0715-b758-4e1b-be47-b13091c43617 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] 10.222.0.30 "GET /compute/v2.1/servers/16226ccb-8bc4-43b6-abd5-7601be0e57b5" status: 200 len: 1721 microversion: 2.20 time: 0.246601 Jun 16 18:34:13.174269 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 271/586] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Jun 16 18:34:12 2022] GET /compute/v2.1/servers/16226ccb-8bc4-43b6-abd5-7601be0e57b5 => generated 1721 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:34:13.620848 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-011e889c-b5dd-45de-a171-dc8784118d7b tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:34:13.621494 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-011e889c-b5dd-45de-a171-dc8784118d7b tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] [instance: 05981bed-b625-4e9a-b860-6a7ce1288e8d] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:34:13.631654 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-011e889c-b5dd-45de-a171-dc8784118d7b tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:13.632301 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-011e889c-b5dd-45de-a171-dc8784118d7b tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:13.633256 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-011e889c-b5dd-45de-a171-dc8784118d7b tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:13.633813 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-011e889c-b5dd-45de-a171-dc8784118d7b tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:13.831843 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-011e889c-b5dd-45de-a171-dc8784118d7b tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512f01cca14b447c8f6c9eebbd828eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70bbccf07e3404cb94ba59201061a6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:34:13.842667 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-011e889c-b5dd-45de-a171-dc8784118d7b tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] 10.222.0.30 "GET /compute/v2.1/servers/05981bed-b625-4e9a-b860-6a7ce1288e8d" status: 200 len: 1508 microversion: 2.1 time: 0.227349 Jun 16 18:34:13.843305 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 316/587] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:34:13 2022] GET /compute/v2.1/servers/05981bed-b625-4e9a-b860-6a7ce1288e8d => generated 1508 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:34:14.209370 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-3c61d19d-2db5-4707-a231-2f3b5ddca759 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:34:14.210530 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-3c61d19d-2db5-4707-a231-2f3b5ddca759 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] [instance: 16226ccb-8bc4-43b6-abd5-7601be0e57b5] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:34:14.231898 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-3c61d19d-2db5-4707-a231-2f3b5ddca759 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:14.232267 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-3c61d19d-2db5-4707-a231-2f3b5ddca759 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:14.233583 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-3c61d19d-2db5-4707-a231-2f3b5ddca759 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:14.234394 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-3c61d19d-2db5-4707-a231-2f3b5ddca759 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:14.456629 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-3c61d19d-2db5-4707-a231-2f3b5ddca759 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:34:14.483008 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-3c61d19d-2db5-4707-a231-2f3b5ddca759 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:34:14.484772 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-3c61d19d-2db5-4707-a231-2f3b5ddca759 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:34:14.490650 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-3c61d19d-2db5-4707-a231-2f3b5ddca759 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] 10.222.0.30 "GET /compute/v2.1/servers/16226ccb-8bc4-43b6-abd5-7601be0e57b5" status: 200 len: 1721 microversion: 2.20 time: 0.285858 Jun 16 18:34:14.491337 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 272/588] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Jun 16 18:34:14 2022] GET /compute/v2.1/servers/16226ccb-8bc4-43b6-abd5-7601be0e57b5 => generated 1721 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:34:14.861878 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-ef6a949b-a46b-48fb-88e5-87fd01957cbb tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:34:14.863394 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-ef6a949b-a46b-48fb-88e5-87fd01957cbb tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] [instance: 05981bed-b625-4e9a-b860-6a7ce1288e8d] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:34:14.874299 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-ef6a949b-a46b-48fb-88e5-87fd01957cbb tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:14.875002 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-ef6a949b-a46b-48fb-88e5-87fd01957cbb tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:14.876147 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-ef6a949b-a46b-48fb-88e5-87fd01957cbb tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:14.876735 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-ef6a949b-a46b-48fb-88e5-87fd01957cbb tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:15.109925 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-ef6a949b-a46b-48fb-88e5-87fd01957cbb tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512f01cca14b447c8f6c9eebbd828eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70bbccf07e3404cb94ba59201061a6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:34:15.121873 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-ef6a949b-a46b-48fb-88e5-87fd01957cbb tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] 10.222.0.30 "GET /compute/v2.1/servers/05981bed-b625-4e9a-b860-6a7ce1288e8d" status: 200 len: 1508 microversion: 2.1 time: 0.264068 Jun 16 18:34:15.122959 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 317/589] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:34:14 2022] GET /compute/v2.1/servers/05981bed-b625-4e9a-b860-6a7ce1288e8d => generated 1508 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:34:15.379603 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [req-bed60862-a77f-47be-b382-261f324cea91 req-070c0ad9-f5b8-4dab-b9fe-560ac7753742 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "05981bed-b625-4e9a-b860-6a7ce1288e8d", "name": "network-vif-deleted", "tag": "67e8bc05-0984-4a56-9695-39dbb5154e2d"}]} {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:34:15.409057 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [req-bed60862-a77f-47be-b382-261f324cea91 req-070c0ad9-f5b8-4dab-b9fe-560ac7753742 service nova] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:15.410311 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [req-bed60862-a77f-47be-b382-261f324cea91 req-070c0ad9-f5b8-4dab-b9fe-560ac7753742 service nova] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:15.438285 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.compute.server_external_events [req-bed60862-a77f-47be-b382-261f324cea91 req-070c0ad9-f5b8-4dab-b9fe-560ac7753742 service nova] Creating event network-vif-deleted:67e8bc05-0984-4a56-9695-39dbb5154e2d for instance 05981bed-b625-4e9a-b860-6a7ce1288e8d on hv-cinder-81322 Jun 16 18:34:15.446415 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [req-bed60862-a77f-47be-b382-261f324cea91 req-070c0ad9-f5b8-4dab-b9fe-560ac7753742 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076639 Jun 16 18:34:15.447742 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 273/590] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Jun 16 18:34:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:34:15.526142 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-ddb7ce6f-0ab4-4448-bf64-29648961b330 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:34:15.526861 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-ddb7ce6f-0ab4-4448-bf64-29648961b330 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] [instance: 16226ccb-8bc4-43b6-abd5-7601be0e57b5] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:34:15.536323 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-ddb7ce6f-0ab4-4448-bf64-29648961b330 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:15.537187 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-ddb7ce6f-0ab4-4448-bf64-29648961b330 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:15.538296 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-ddb7ce6f-0ab4-4448-bf64-29648961b330 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:15.538786 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-ddb7ce6f-0ab4-4448-bf64-29648961b330 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:15.893945 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-ddb7ce6f-0ab4-4448-bf64-29648961b330 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:34:15.913644 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-ddb7ce6f-0ab4-4448-bf64-29648961b330 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:34:15.917705 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-ddb7ce6f-0ab4-4448-bf64-29648961b330 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:34:15.937117 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-ddb7ce6f-0ab4-4448-bf64-29648961b330 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] 10.222.0.30 "GET /compute/v2.1/servers/16226ccb-8bc4-43b6-abd5-7601be0e57b5" status: 200 len: 1721 microversion: 2.20 time: 0.416690 Jun 16 18:34:15.938179 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 318/591] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Jun 16 18:34:15 2022] GET /compute/v2.1/servers/16226ccb-8bc4-43b6-abd5-7601be0e57b5 => generated 1721 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:34:16.148906 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-a13f85fa-9ac9-43c3-8c68-c2445d39e9bd tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:34:16.151129 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-a13f85fa-9ac9-43c3-8c68-c2445d39e9bd tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] [instance: 05981bed-b625-4e9a-b860-6a7ce1288e8d] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:34:16.169900 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-a13f85fa-9ac9-43c3-8c68-c2445d39e9bd tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:16.170711 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-a13f85fa-9ac9-43c3-8c68-c2445d39e9bd tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:16.172506 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-a13f85fa-9ac9-43c3-8c68-c2445d39e9bd tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:16.173227 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-a13f85fa-9ac9-43c3-8c68-c2445d39e9bd tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:16.199405 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.wsgi [None req-a13f85fa-9ac9-43c3-8c68-c2445d39e9bd tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] HTTP exception thrown: Instance 05981bed-b625-4e9a-b860-6a7ce1288e8d could not be found. Jun 16 18:34:16.203020 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-a13f85fa-9ac9-43c3-8c68-c2445d39e9bd tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Request method failure captured: Jun 16 18:34:16.203020 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: request: GET /compute/v2.1/servers/05981bed-b625-4e9a-b860-6a7ce1288e8d HTTP/1.1 Jun 16 18:34:16.203020 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: Accept: application/json Jun 16 18:34:16.203020 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: Accept-Encoding: identity Jun 16 18:34:16.203020 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: Connection: close Jun 16 18:34:16.203020 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: Content-Length: 0 Jun 16 18:34:16.203020 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: Content-Type: application/json Jun 16 18:34:16.203020 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: Host: 10.222.0.30 Jun 16 18:34:16.203020 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: Openstack-System-Scope: None Jun 16 18:34:16.203020 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: User-Agent: python-urllib3/1.26.9 Jun 16 18:34:16.203020 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Auth-Token: gAAAAABiq3ZeOWVXrcHoFQenWS7gEz2AmLT0pk9WALQKP9rY-D8or65AIFivXjSOMGuT5nkfTCPX-UgC2J78DfMkn6N1K-iY82TmKX61g47gNVuWG9jlnvzIzdHnPvexbz1CwR9za6ZIAFnBpf6Y_L3GTnzg7Lzmn3ZLTYDBiHKMrCwhKJPoGQI Jun 16 18:34:16.203020 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Domain-Id: None Jun 16 18:34:16.203020 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Domain-Name: None Jun 16 18:34:16.203020 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Identity-Status: Confirmed Jun 16 18:34:16.203020 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Is-Admin-Project: True Jun 16 18:34:16.203020 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Project-Domain-Id: default Jun 16 18:34:16.203020 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Project-Domain-Name: Default Jun 16 18:34:16.203020 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Project-Id: b70bbccf07e3404cb94ba59201061a6a Jun 16 18:34:16.203020 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1891572618 Jun 16 18:34:16.203020 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Role: reader,member Jun 16 18:34:16.203020 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Roles: reader,member Jun 16 18:34:16.205362 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/b70bbccf07e3404cb94ba59201061a6a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/b70bbccf07e3404cb94ba59201061a6a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_b70bbccf07e3404cb94ba59201061a6a", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/b70bbccf07e3404cb94ba59201061a6a"}]}] Jun 16 18:34:16.205362 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1891572618 Jun 16 18:34:16.205362 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Tenant-Id: b70bbccf07e3404cb94ba59201061a6a Jun 16 18:34:16.205362 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1891572618 Jun 16 18:34:16.205362 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-User: tempest-ServerRescueNegativeTestJSON-1891572618-project Jun 16 18:34:16.205362 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-User-Domain-Id: default Jun 16 18:34:16.205362 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-User-Domain-Name: Default Jun 16 18:34:16.205362 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-User-Id: 512f01cca14b447c8f6c9eebbd828eb2 Jun 16 18:34:16.205362 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1891572618-project Jun 16 18:34:16.205362 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: method: > Jun 16 18:34:16.205362 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: exception: Instance 05981bed-b625-4e9a-b860-6a7ce1288e8d could not be found. Jun 16 18:34:16.205362 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: action_args: {'id': '05981bed-b625-4e9a-b860-6a7ce1288e8d'} Jun 16 18:34:16.206156 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:34:16.206156 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:34:16.206156 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 18:34:16.206156 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 18:34:16.206156 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 18:34:16.206156 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 18:34:16.206156 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 18:34:16.206156 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 18:34:16.206156 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 18:34:16.206156 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 18:34:16.206156 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 05981bed-b625-4e9a-b860-6a7ce1288e8d could not be found. Jun 16 18:34:16.206156 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Jun 16 18:34:16.206156 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:34:16.206156 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Jun 16 18:34:16.206156 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:34:16.206156 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:34:16.206156 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:34:16.206156 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:34:16.206156 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:34:16.206156 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:34:16.209688 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:34:16.209688 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 18:34:16.209688 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 18:34:16.209688 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 18:34:16.209688 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 18:34:16.209688 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 18:34:16.209688 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:34:16.209688 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 05981bed-b625-4e9a-b860-6a7ce1288e8d could not be found. Jun 16 18:34:16.209688 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Jun 16 18:34:16.209688 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:34:16.209688 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Jun 16 18:34:16.209688 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:34:16.209688 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:34:16.209688 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:34:16.209688 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:34:16.209688 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:34:16.209688 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 05981bed-b625-4e9a-b860-6a7ce1288e8d could not be found. Jun 16 18:34:16.209688 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Jun 16 18:34:16.213074 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-a13f85fa-9ac9-43c3-8c68-c2445d39e9bd tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Returning 404 to user: Instance 05981bed-b625-4e9a-b860-6a7ce1288e8d could not be found. {{(pid=117671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:34:16.213074 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-a13f85fa-9ac9-43c3-8c68-c2445d39e9bd tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] 10.222.0.30 "GET /compute/v2.1/servers/05981bed-b625-4e9a-b860-6a7ce1288e8d" status: 404 len: 111 microversion: 2.1 time: 0.067069 Jun 16 18:34:16.213074 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 274/592] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:34:16 2022] GET /compute/v2.1/servers/05981bed-b625-4e9a-b860-6a7ce1288e8d => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:34:16.222197 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-72c69670-bc99-4bea-ae20-46b1d8c13cec tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:34:16.223406 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-72c69670-bc99-4bea-ae20-46b1d8c13cec tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] [instance: e541a8c3-c14c-46db-8b18-23fff07aa1d2] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:34:16.234959 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-72c69670-bc99-4bea-ae20-46b1d8c13cec tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:16.236339 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-72c69670-bc99-4bea-ae20-46b1d8c13cec tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:16.238339 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-72c69670-bc99-4bea-ae20-46b1d8c13cec tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:16.239103 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-72c69670-bc99-4bea-ae20-46b1d8c13cec tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:16.294427 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-72c69670-bc99-4bea-ae20-46b1d8c13cec tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] [instance: e541a8c3-c14c-46db-8b18-23fff07aa1d2] Going to try to terminate instance {{(pid=117670) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 18:34:16.515869 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-72c69670-bc99-4bea-ae20-46b1d8c13cec tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] 10.222.0.30 "DELETE /compute/v2.1/servers/e541a8c3-c14c-46db-8b18-23fff07aa1d2" status: 204 len: 0 microversion: 2.1 time: 0.298587 Jun 16 18:34:16.517228 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 319/593] 10.222.0.30 () {58 vars in 1238 bytes} [Thu Jun 16 18:34:16 2022] DELETE /compute/v2.1/servers/e541a8c3-c14c-46db-8b18-23fff07aa1d2 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 18:34:16.532909 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-88a37c16-f88e-4251-802e-a0465b8f9d26 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:34:16.534498 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-88a37c16-f88e-4251-802e-a0465b8f9d26 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] [instance: e541a8c3-c14c-46db-8b18-23fff07aa1d2] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:34:16.549220 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-88a37c16-f88e-4251-802e-a0465b8f9d26 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:16.553111 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-88a37c16-f88e-4251-802e-a0465b8f9d26 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:16.565929 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-88a37c16-f88e-4251-802e-a0465b8f9d26 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:16.566968 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-88a37c16-f88e-4251-802e-a0465b8f9d26 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:16.789357 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-88a37c16-f88e-4251-802e-a0465b8f9d26 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512f01cca14b447c8f6c9eebbd828eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70bbccf07e3404cb94ba59201061a6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:34:16.797921 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-88a37c16-f88e-4251-802e-a0465b8f9d26 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] 10.222.0.30 "GET /compute/v2.1/servers/e541a8c3-c14c-46db-8b18-23fff07aa1d2" status: 200 len: 1521 microversion: 2.1 time: 0.273433 Jun 16 18:34:16.798638 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 275/594] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:34:16 2022] GET /compute/v2.1/servers/e541a8c3-c14c-46db-8b18-23fff07aa1d2 => generated 1521 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:34:16.960385 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-05858781-a889-43b5-90ab-999ee03322ec tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:34:16.961050 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-05858781-a889-43b5-90ab-999ee03322ec tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] [instance: 16226ccb-8bc4-43b6-abd5-7601be0e57b5] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:34:16.969364 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-05858781-a889-43b5-90ab-999ee03322ec tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:16.969803 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-05858781-a889-43b5-90ab-999ee03322ec tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:16.970578 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-05858781-a889-43b5-90ab-999ee03322ec tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:16.971010 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-05858781-a889-43b5-90ab-999ee03322ec tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:17.183406 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-05858781-a889-43b5-90ab-999ee03322ec tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:34:17.192447 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-05858781-a889-43b5-90ab-999ee03322ec tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:34:17.194899 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-05858781-a889-43b5-90ab-999ee03322ec tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:34:17.196328 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-05858781-a889-43b5-90ab-999ee03322ec tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] 10.222.0.30 "GET /compute/v2.1/servers/16226ccb-8bc4-43b6-abd5-7601be0e57b5" status: 200 len: 1721 microversion: 2.20 time: 0.243030 Jun 16 18:34:17.196962 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 320/595] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Jun 16 18:34:16 2022] GET /compute/v2.1/servers/16226ccb-8bc4-43b6-abd5-7601be0e57b5 => generated 1721 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:34:17.821916 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-4499cdcb-e88f-46a9-9174-46c6c994020c tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:34:17.823040 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-4499cdcb-e88f-46a9-9174-46c6c994020c tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] [instance: e541a8c3-c14c-46db-8b18-23fff07aa1d2] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:34:17.831727 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-4499cdcb-e88f-46a9-9174-46c6c994020c tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:17.832324 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-4499cdcb-e88f-46a9-9174-46c6c994020c tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:17.833163 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-4499cdcb-e88f-46a9-9174-46c6c994020c tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:17.833610 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-4499cdcb-e88f-46a9-9174-46c6c994020c tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:18.019552 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-4499cdcb-e88f-46a9-9174-46c6c994020c tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512f01cca14b447c8f6c9eebbd828eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70bbccf07e3404cb94ba59201061a6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:34:18.031699 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-4499cdcb-e88f-46a9-9174-46c6c994020c tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] 10.222.0.30 "GET /compute/v2.1/servers/e541a8c3-c14c-46db-8b18-23fff07aa1d2" status: 200 len: 1521 microversion: 2.1 time: 0.217443 Jun 16 18:34:18.032880 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 276/596] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:34:17 2022] GET /compute/v2.1/servers/e541a8c3-c14c-46db-8b18-23fff07aa1d2 => generated 1521 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:34:18.215824 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-41302066-87fb-4667-a21d-dfeb9e0924ca tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:34:18.216543 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-41302066-87fb-4667-a21d-dfeb9e0924ca tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] [instance: 16226ccb-8bc4-43b6-abd5-7601be0e57b5] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:34:18.223573 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-41302066-87fb-4667-a21d-dfeb9e0924ca tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:18.224016 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-41302066-87fb-4667-a21d-dfeb9e0924ca tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:18.225603 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-41302066-87fb-4667-a21d-dfeb9e0924ca tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:18.226038 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-41302066-87fb-4667-a21d-dfeb9e0924ca tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:18.243154 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG dbcounter [-] [117670] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:34:18.388752 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-41302066-87fb-4667-a21d-dfeb9e0924ca tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:34:18.398586 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-41302066-87fb-4667-a21d-dfeb9e0924ca tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:34:18.400193 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-41302066-87fb-4667-a21d-dfeb9e0924ca tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:34:18.401424 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-41302066-87fb-4667-a21d-dfeb9e0924ca tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] 10.222.0.30 "GET /compute/v2.1/servers/16226ccb-8bc4-43b6-abd5-7601be0e57b5" status: 200 len: 1721 microversion: 2.20 time: 0.189737 Jun 16 18:34:18.402006 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 321/597] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Jun 16 18:34:18 2022] GET /compute/v2.1/servers/16226ccb-8bc4-43b6-abd5-7601be0e57b5 => generated 1721 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:34:19.054529 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-4c7d1098-4e76-42b1-b306-0435cce0b7d2 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:34:19.055180 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-4c7d1098-4e76-42b1-b306-0435cce0b7d2 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] [instance: e541a8c3-c14c-46db-8b18-23fff07aa1d2] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:34:19.062415 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-4c7d1098-4e76-42b1-b306-0435cce0b7d2 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:19.062870 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-4c7d1098-4e76-42b1-b306-0435cce0b7d2 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:19.063672 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-4c7d1098-4e76-42b1-b306-0435cce0b7d2 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:19.064165 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-4c7d1098-4e76-42b1-b306-0435cce0b7d2 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:19.225572 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-4c7d1098-4e76-42b1-b306-0435cce0b7d2 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512f01cca14b447c8f6c9eebbd828eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70bbccf07e3404cb94ba59201061a6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:34:19.233925 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-4c7d1098-4e76-42b1-b306-0435cce0b7d2 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] 10.222.0.30 "GET /compute/v2.1/servers/e541a8c3-c14c-46db-8b18-23fff07aa1d2" status: 200 len: 1521 microversion: 2.1 time: 0.183505 Jun 16 18:34:19.234511 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 277/598] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:34:19 2022] GET /compute/v2.1/servers/e541a8c3-c14c-46db-8b18-23fff07aa1d2 => generated 1521 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:34:19.422178 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-a6021e89-58aa-4e29-9d4a-ca5e2411eb8e tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:34:19.422898 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-a6021e89-58aa-4e29-9d4a-ca5e2411eb8e tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] [instance: 16226ccb-8bc4-43b6-abd5-7601be0e57b5] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:34:19.430693 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-a6021e89-58aa-4e29-9d4a-ca5e2411eb8e tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:19.431211 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-a6021e89-58aa-4e29-9d4a-ca5e2411eb8e tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:19.432080 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-a6021e89-58aa-4e29-9d4a-ca5e2411eb8e tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:19.432592 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-a6021e89-58aa-4e29-9d4a-ca5e2411eb8e tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:19.597354 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-a6021e89-58aa-4e29-9d4a-ca5e2411eb8e tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:34:19.616280 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-a6021e89-58aa-4e29-9d4a-ca5e2411eb8e tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:34:19.619793 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-a6021e89-58aa-4e29-9d4a-ca5e2411eb8e tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:34:19.622182 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-a6021e89-58aa-4e29-9d4a-ca5e2411eb8e tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] 10.222.0.30 "GET /compute/v2.1/servers/16226ccb-8bc4-43b6-abd5-7601be0e57b5" status: 200 len: 1721 microversion: 2.20 time: 0.204670 Jun 16 18:34:19.623241 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 322/599] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Jun 16 18:34:19 2022] GET /compute/v2.1/servers/16226ccb-8bc4-43b6-abd5-7601be0e57b5 => generated 1721 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 18:34:20.259456 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-8f7b71fd-74dd-46f3-89f5-804d312a71a6 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:34:20.261020 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-8f7b71fd-74dd-46f3-89f5-804d312a71a6 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] [instance: e541a8c3-c14c-46db-8b18-23fff07aa1d2] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:34:20.277009 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-8f7b71fd-74dd-46f3-89f5-804d312a71a6 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:20.277971 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-8f7b71fd-74dd-46f3-89f5-804d312a71a6 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:20.279807 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-8f7b71fd-74dd-46f3-89f5-804d312a71a6 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:20.280749 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-8f7b71fd-74dd-46f3-89f5-804d312a71a6 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:20.655004 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-b292e1d9-f48a-485e-899c-c6af26075f95 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:34:20.656117 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-b292e1d9-f48a-485e-899c-c6af26075f95 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] [instance: 16226ccb-8bc4-43b6-abd5-7601be0e57b5] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:34:20.667982 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-b292e1d9-f48a-485e-899c-c6af26075f95 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:20.668791 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-b292e1d9-f48a-485e-899c-c6af26075f95 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:20.669648 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-b292e1d9-f48a-485e-899c-c6af26075f95 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:20.670518 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-b292e1d9-f48a-485e-899c-c6af26075f95 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:21.022361 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-8f7b71fd-74dd-46f3-89f5-804d312a71a6 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '512f01cca14b447c8f6c9eebbd828eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70bbccf07e3404cb94ba59201061a6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:34:21.032462 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-8f7b71fd-74dd-46f3-89f5-804d312a71a6 tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] 10.222.0.30 "GET /compute/v2.1/servers/e541a8c3-c14c-46db-8b18-23fff07aa1d2" status: 200 len: 1521 microversion: 2.1 time: 0.782975 Jun 16 18:34:21.035411 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 278/600] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:34:20 2022] GET /compute/v2.1/servers/e541a8c3-c14c-46db-8b18-23fff07aa1d2 => generated 1521 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:34:21.105086 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-b292e1d9-f48a-485e-899c-c6af26075f95 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:34:21.117510 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-b292e1d9-f48a-485e-899c-c6af26075f95 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:34:21.120032 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-b292e1d9-f48a-485e-899c-c6af26075f95 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:34:21.121526 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-b292e1d9-f48a-485e-899c-c6af26075f95 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] 10.222.0.30 "GET /compute/v2.1/servers/16226ccb-8bc4-43b6-abd5-7601be0e57b5" status: 200 len: 1742 microversion: 2.20 time: 0.473690 Jun 16 18:34:21.122444 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 323/601] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Jun 16 18:34:20 2022] GET /compute/v2.1/servers/16226ccb-8bc4-43b6-abd5-7601be0e57b5 => generated 1742 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 18:34:21.187704 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [req-cce7ad92-af3a-4da8-b782-448753193d6a req-cd758017-e8ea-4c37-b509-347a08a70ec5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e541a8c3-c14c-46db-8b18-23fff07aa1d2", "name": "network-vif-deleted", "tag": "88f4692a-7c46-4581-9664-8a005ca35a74"}]} {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:34:21.196995 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [req-cce7ad92-af3a-4da8-b782-448753193d6a req-cd758017-e8ea-4c37-b509-347a08a70ec5 service nova] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:21.197444 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [req-cce7ad92-af3a-4da8-b782-448753193d6a req-cd758017-e8ea-4c37-b509-347a08a70ec5 service nova] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:21.211079 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.compute.server_external_events [req-cce7ad92-af3a-4da8-b782-448753193d6a req-cd758017-e8ea-4c37-b509-347a08a70ec5 service nova] Creating event network-vif-deleted:88f4692a-7c46-4581-9664-8a005ca35a74 for instance e541a8c3-c14c-46db-8b18-23fff07aa1d2 on hv-cinder-81322 Jun 16 18:34:21.216562 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [req-cce7ad92-af3a-4da8-b782-448753193d6a req-cd758017-e8ea-4c37-b509-347a08a70ec5 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.141687 Jun 16 18:34:21.217513 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 279/602] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Jun 16 18:34:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:34:22.055519 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-8bdd05b0-c3ee-4944-a676-1af9afb1fb2e tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:34:22.057328 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-8bdd05b0-c3ee-4944-a676-1af9afb1fb2e tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] [instance: e541a8c3-c14c-46db-8b18-23fff07aa1d2] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:34:22.073255 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-8bdd05b0-c3ee-4944-a676-1af9afb1fb2e tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:22.073930 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-8bdd05b0-c3ee-4944-a676-1af9afb1fb2e tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:22.075322 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-8bdd05b0-c3ee-4944-a676-1af9afb1fb2e tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:22.076222 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-8bdd05b0-c3ee-4944-a676-1af9afb1fb2e tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:22.096344 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.wsgi [None req-8bdd05b0-c3ee-4944-a676-1af9afb1fb2e tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] HTTP exception thrown: Instance e541a8c3-c14c-46db-8b18-23fff07aa1d2 could not be found. Jun 16 18:34:22.098141 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-8bdd05b0-c3ee-4944-a676-1af9afb1fb2e tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Request method failure captured: Jun 16 18:34:22.098141 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: request: GET /compute/v2.1/servers/e541a8c3-c14c-46db-8b18-23fff07aa1d2 HTTP/1.1 Jun 16 18:34:22.098141 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: Accept: application/json Jun 16 18:34:22.098141 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: Accept-Encoding: identity Jun 16 18:34:22.098141 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: Connection: close Jun 16 18:34:22.098141 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: Content-Length: 0 Jun 16 18:34:22.098141 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: Content-Type: application/json Jun 16 18:34:22.098141 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: Host: 10.222.0.30 Jun 16 18:34:22.098141 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: Openstack-System-Scope: None Jun 16 18:34:22.098141 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: User-Agent: python-urllib3/1.26.9 Jun 16 18:34:22.098141 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Auth-Token: gAAAAABiq3ZeOWVXrcHoFQenWS7gEz2AmLT0pk9WALQKP9rY-D8or65AIFivXjSOMGuT5nkfTCPX-UgC2J78DfMkn6N1K-iY82TmKX61g47gNVuWG9jlnvzIzdHnPvexbz1CwR9za6ZIAFnBpf6Y_L3GTnzg7Lzmn3ZLTYDBiHKMrCwhKJPoGQI Jun 16 18:34:22.098141 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Domain-Id: None Jun 16 18:34:22.098141 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Domain-Name: None Jun 16 18:34:22.098141 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Identity-Status: Confirmed Jun 16 18:34:22.098141 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Is-Admin-Project: True Jun 16 18:34:22.098141 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Project-Domain-Id: default Jun 16 18:34:22.098141 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Project-Domain-Name: Default Jun 16 18:34:22.098141 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Project-Id: b70bbccf07e3404cb94ba59201061a6a Jun 16 18:34:22.098141 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1891572618 Jun 16 18:34:22.098141 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Role: reader,member Jun 16 18:34:22.098141 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Roles: reader,member Jun 16 18:34:22.101159 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/b70bbccf07e3404cb94ba59201061a6a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/b70bbccf07e3404cb94ba59201061a6a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_b70bbccf07e3404cb94ba59201061a6a", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/b70bbccf07e3404cb94ba59201061a6a"}]}] Jun 16 18:34:22.101159 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1891572618 Jun 16 18:34:22.101159 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Tenant-Id: b70bbccf07e3404cb94ba59201061a6a Jun 16 18:34:22.101159 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1891572618 Jun 16 18:34:22.101159 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-User: tempest-ServerRescueNegativeTestJSON-1891572618-project Jun 16 18:34:22.101159 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-User-Domain-Id: default Jun 16 18:34:22.101159 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-User-Domain-Name: Default Jun 16 18:34:22.101159 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-User-Id: 512f01cca14b447c8f6c9eebbd828eb2 Jun 16 18:34:22.101159 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1891572618-project Jun 16 18:34:22.101159 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: method: > Jun 16 18:34:22.101159 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: exception: Instance e541a8c3-c14c-46db-8b18-23fff07aa1d2 could not be found. Jun 16 18:34:22.101159 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: action_args: {'id': 'e541a8c3-c14c-46db-8b18-23fff07aa1d2'} Jun 16 18:34:22.102547 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:34:22.102547 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:34:22.102547 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 18:34:22.102547 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 18:34:22.102547 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 18:34:22.102547 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 18:34:22.102547 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 18:34:22.102547 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 18:34:22.102547 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 18:34:22.102547 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 18:34:22.102547 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e541a8c3-c14c-46db-8b18-23fff07aa1d2 could not be found. Jun 16 18:34:22.102547 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi Jun 16 18:34:22.102547 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:34:22.102547 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi Jun 16 18:34:22.102547 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:34:22.102547 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:34:22.102547 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:34:22.102547 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:34:22.102547 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:34:22.102547 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:34:22.104460 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:34:22.104460 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 18:34:22.104460 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 18:34:22.104460 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 18:34:22.104460 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 18:34:22.104460 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 18:34:22.104460 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:34:22.104460 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e541a8c3-c14c-46db-8b18-23fff07aa1d2 could not be found. Jun 16 18:34:22.104460 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi Jun 16 18:34:22.104460 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:34:22.104460 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi Jun 16 18:34:22.104460 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:34:22.104460 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:34:22.104460 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:34:22.104460 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:34:22.104460 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:34:22.104460 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e541a8c3-c14c-46db-8b18-23fff07aa1d2 could not be found. Jun 16 18:34:22.104460 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi Jun 16 18:34:22.106368 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-8bdd05b0-c3ee-4944-a676-1af9afb1fb2e tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] Returning 404 to user: Instance e541a8c3-c14c-46db-8b18-23fff07aa1d2 could not be found. {{(pid=117670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:34:22.106368 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-8bdd05b0-c3ee-4944-a676-1af9afb1fb2e tempest-ServerRescueNegativeTestJSON-1891572618 tempest-ServerRescueNegativeTestJSON-1891572618-project] 10.222.0.30 "GET /compute/v2.1/servers/e541a8c3-c14c-46db-8b18-23fff07aa1d2" status: 404 len: 111 microversion: 2.1 time: 0.049907 Jun 16 18:34:22.106368 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 324/603] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:34:22 2022] GET /compute/v2.1/servers/e541a8c3-c14c-46db-8b18-23fff07aa1d2 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:34:22.155541 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-cd6940dd-3545-437e-ab16-2af610f5592f tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:34:22.157111 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-cd6940dd-3545-437e-ab16-2af610f5592f tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] [instance: 16226ccb-8bc4-43b6-abd5-7601be0e57b5] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:34:22.160883 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG dbcounter [-] [117671] Writing DB stats nova_cell0:SELECT=4 {{(pid=117671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:34:22.170030 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-cd6940dd-3545-437e-ab16-2af610f5592f tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:22.170660 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-cd6940dd-3545-437e-ab16-2af610f5592f tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:22.171968 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-cd6940dd-3545-437e-ab16-2af610f5592f tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:22.172631 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-cd6940dd-3545-437e-ab16-2af610f5592f tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:22.179653 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG dbcounter [-] [117671] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:34:22.378053 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-cd6940dd-3545-437e-ab16-2af610f5592f tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:34:22.393776 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-cd6940dd-3545-437e-ab16-2af610f5592f tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:34:22.399390 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-cd6940dd-3545-437e-ab16-2af610f5592f tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:34:22.403151 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-cd6940dd-3545-437e-ab16-2af610f5592f tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] 10.222.0.30 "GET /compute/v2.1/servers/16226ccb-8bc4-43b6-abd5-7601be0e57b5" status: 200 len: 1742 microversion: 2.20 time: 0.252836 Jun 16 18:34:22.404920 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 280/604] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Jun 16 18:34:22 2022] GET /compute/v2.1/servers/16226ccb-8bc4-43b6-abd5-7601be0e57b5 => generated 1742 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:34:23.424447 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-10d9a0cd-ab18-41cb-adcd-8ad086321cea tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:34:23.425961 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-10d9a0cd-ab18-41cb-adcd-8ad086321cea tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] [instance: 16226ccb-8bc4-43b6-abd5-7601be0e57b5] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:34:23.439271 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-10d9a0cd-ab18-41cb-adcd-8ad086321cea tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:23.440197 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-10d9a0cd-ab18-41cb-adcd-8ad086321cea tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:23.441242 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-10d9a0cd-ab18-41cb-adcd-8ad086321cea tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:23.442008 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-10d9a0cd-ab18-41cb-adcd-8ad086321cea tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:23.824235 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-10d9a0cd-ab18-41cb-adcd-8ad086321cea tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:34:23.837143 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-10d9a0cd-ab18-41cb-adcd-8ad086321cea tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:34:23.838678 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-10d9a0cd-ab18-41cb-adcd-8ad086321cea tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:34:23.840158 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-10d9a0cd-ab18-41cb-adcd-8ad086321cea tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] 10.222.0.30 "GET /compute/v2.1/servers/16226ccb-8bc4-43b6-abd5-7601be0e57b5" status: 200 len: 1737 microversion: 2.20 time: 0.420805 Jun 16 18:34:23.840952 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 325/605] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Jun 16 18:34:23 2022] GET /compute/v2.1/servers/16226ccb-8bc4-43b6-abd5-7601be0e57b5 => generated 1737 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:34:24.863055 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-5a5a5bbf-340e-44af-b47c-55666546cc5d tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:34:24.864850 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-5a5a5bbf-340e-44af-b47c-55666546cc5d tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] [instance: 16226ccb-8bc4-43b6-abd5-7601be0e57b5] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:34:24.900385 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-5a5a5bbf-340e-44af-b47c-55666546cc5d tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:24.900982 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-5a5a5bbf-340e-44af-b47c-55666546cc5d tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:24.902269 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-5a5a5bbf-340e-44af-b47c-55666546cc5d tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:24.902712 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-5a5a5bbf-340e-44af-b47c-55666546cc5d tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:25.207766 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-5a5a5bbf-340e-44af-b47c-55666546cc5d tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:34:25.237241 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-5a5a5bbf-340e-44af-b47c-55666546cc5d tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:34:25.238105 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [req-012a12bb-dacb-4abd-b601-bcf4b2cc5eac req-7376a543-9bf4-43b5-89e5-5398624a4e82 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16226ccb-8bc4-43b6-abd5-7601be0e57b5", "name": "network-vif-plugged", "status": "completed", "tag": "fc74ff6c-f681-43e5-ba34-42732de13dac"}]} {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:34:25.242844 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-5a5a5bbf-340e-44af-b47c-55666546cc5d tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:34:25.251149 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-5a5a5bbf-340e-44af-b47c-55666546cc5d tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] 10.222.0.30 "GET /compute/v2.1/servers/16226ccb-8bc4-43b6-abd5-7601be0e57b5" status: 200 len: 1737 microversion: 2.20 time: 0.386402 Jun 16 18:34:25.252323 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 281/606] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Jun 16 18:34:24 2022] GET /compute/v2.1/servers/16226ccb-8bc4-43b6-abd5-7601be0e57b5 => generated 1737 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:34:25.301203 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [req-012a12bb-dacb-4abd-b601-bcf4b2cc5eac req-7376a543-9bf4-43b5-89e5-5398624a4e82 service nova] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:25.308896 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [req-012a12bb-dacb-4abd-b601-bcf4b2cc5eac req-7376a543-9bf4-43b5-89e5-5398624a4e82 service nova] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:25.352324 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.compute.server_external_events [req-012a12bb-dacb-4abd-b601-bcf4b2cc5eac req-7376a543-9bf4-43b5-89e5-5398624a4e82 service nova] Creating event network-vif-plugged:fc74ff6c-f681-43e5-ba34-42732de13dac for instance 16226ccb-8bc4-43b6-abd5-7601be0e57b5 on hv-cinder-81322 Jun 16 18:34:25.362352 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [req-012a12bb-dacb-4abd-b601-bcf4b2cc5eac req-7376a543-9bf4-43b5-89e5-5398624a4e82 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.140862 Jun 16 18:34:25.364452 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 326/607] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Jun 16 18:34:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:34:26.294323 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-9e80b050-f3bb-4265-9d62-58e787fe070d tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:34:26.309974 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-9e80b050-f3bb-4265-9d62-58e787fe070d tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] [instance: 16226ccb-8bc4-43b6-abd5-7601be0e57b5] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:34:26.344356 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-9e80b050-f3bb-4265-9d62-58e787fe070d tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:26.354436 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-9e80b050-f3bb-4265-9d62-58e787fe070d tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:26.359790 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-9e80b050-f3bb-4265-9d62-58e787fe070d tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:26.361043 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-9e80b050-f3bb-4265-9d62-58e787fe070d tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:26.696774 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-9e80b050-f3bb-4265-9d62-58e787fe070d tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:34:26.713873 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-9e80b050-f3bb-4265-9d62-58e787fe070d tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:34:26.717596 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-9e80b050-f3bb-4265-9d62-58e787fe070d tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:34:26.721190 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-9e80b050-f3bb-4265-9d62-58e787fe070d tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] 10.222.0.30 "GET /compute/v2.1/servers/16226ccb-8bc4-43b6-abd5-7601be0e57b5" status: 200 len: 1737 microversion: 2.20 time: 0.453421 Jun 16 18:34:26.722985 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 282/608] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Jun 16 18:34:26 2022] GET /compute/v2.1/servers/16226ccb-8bc4-43b6-abd5-7601be0e57b5 => generated 1737 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:34:27.744435 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-a2a647be-441e-49f8-b757-10fd80461b42 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:34:27.745802 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-a2a647be-441e-49f8-b757-10fd80461b42 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] [instance: 16226ccb-8bc4-43b6-abd5-7601be0e57b5] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:34:27.755005 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-a2a647be-441e-49f8-b757-10fd80461b42 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:27.756571 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-a2a647be-441e-49f8-b757-10fd80461b42 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:27.757678 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-a2a647be-441e-49f8-b757-10fd80461b42 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:27.758319 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-a2a647be-441e-49f8-b757-10fd80461b42 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:27.995875 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-a2a647be-441e-49f8-b757-10fd80461b42 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:34:28.048246 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-a2a647be-441e-49f8-b757-10fd80461b42 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:34:28.054820 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-a2a647be-441e-49f8-b757-10fd80461b42 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:34:28.056797 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-a2a647be-441e-49f8-b757-10fd80461b42 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] 10.222.0.30 "GET /compute/v2.1/servers/16226ccb-8bc4-43b6-abd5-7601be0e57b5" status: 200 len: 1737 microversion: 2.20 time: 0.319024 Jun 16 18:34:28.057935 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 327/609] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Jun 16 18:34:27 2022] GET /compute/v2.1/servers/16226ccb-8bc4-43b6-abd5-7601be0e57b5 => generated 1737 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:34:29.092721 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-f07c55c3-fd8d-44e4-ae94-f1caf5029f7c tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:34:29.093858 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-f07c55c3-fd8d-44e4-ae94-f1caf5029f7c tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] [instance: 16226ccb-8bc4-43b6-abd5-7601be0e57b5] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:34:29.114497 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-f07c55c3-fd8d-44e4-ae94-f1caf5029f7c tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:29.115347 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-f07c55c3-fd8d-44e4-ae94-f1caf5029f7c tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:29.117089 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-f07c55c3-fd8d-44e4-ae94-f1caf5029f7c tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:29.118987 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-f07c55c3-fd8d-44e4-ae94-f1caf5029f7c tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:29.361590 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-f07c55c3-fd8d-44e4-ae94-f1caf5029f7c tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:34:29.377198 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-f07c55c3-fd8d-44e4-ae94-f1caf5029f7c tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:34:29.381253 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-f07c55c3-fd8d-44e4-ae94-f1caf5029f7c tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:34:29.383782 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-f07c55c3-fd8d-44e4-ae94-f1caf5029f7c tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] 10.222.0.30 "GET /compute/v2.1/servers/16226ccb-8bc4-43b6-abd5-7601be0e57b5" status: 200 len: 1737 microversion: 2.20 time: 0.298956 Jun 16 18:34:29.385143 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 283/610] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Jun 16 18:34:29 2022] GET /compute/v2.1/servers/16226ccb-8bc4-43b6-abd5-7601be0e57b5 => generated 1737 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:34:29.845778 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-41649b9e-f547-488a-90b6-a97b55cc0ffd tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1339388796", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1758465465", "security_groups": [{"name": "tempest-secgroup-smoke-862090796"}], "networks": [{"uuid": "10541a62-0923-4d1d-8a23-f7599c1118d2"}], "block_device_mapping_v2": [{"uuid": "bab72cae-77de-44ab-a8c7-a1e17c684ff1", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:34:30.111155 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.network.neutron [None req-41649b9e-f547-488a-90b6-a97b55cc0ffd tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] validate_networks() for [('10541a62-0923-4d1d-8a23-f7599c1118d2', None, None, None, None, None)] {{(pid=117670) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 18:34:30.417237 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-496e9f02-5462-4d52-96eb-301929370275 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:34:30.419349 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-496e9f02-5462-4d52-96eb-301929370275 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] [instance: 16226ccb-8bc4-43b6-abd5-7601be0e57b5] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:34:30.439089 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-496e9f02-5462-4d52-96eb-301929370275 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:30.440267 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-496e9f02-5462-4d52-96eb-301929370275 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:30.442597 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-496e9f02-5462-4d52-96eb-301929370275 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:30.443754 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-496e9f02-5462-4d52-96eb-301929370275 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:30.679252 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-496e9f02-5462-4d52-96eb-301929370275 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:34:30.701091 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-496e9f02-5462-4d52-96eb-301929370275 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:34:30.703184 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-496e9f02-5462-4d52-96eb-301929370275 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:34:30.705099 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-496e9f02-5462-4d52-96eb-301929370275 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] 10.222.0.30 "GET /compute/v2.1/servers/16226ccb-8bc4-43b6-abd5-7601be0e57b5" status: 200 len: 1737 microversion: 2.20 time: 0.302889 Jun 16 18:34:30.706542 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 284/611] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Jun 16 18:34:30 2022] GET /compute/v2.1/servers/16226ccb-8bc4-43b6-abd5-7601be0e57b5 => generated 1737 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:34:31.071320 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.virt.hardware [None req-41649b9e-f547-488a-90b6-a97b55cc0ffd tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Flavor limits 0:0:0 {{(pid=117670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 18:34:31.072424 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.virt.hardware [None req-41649b9e-f547-488a-90b6-a97b55cc0ffd tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Image limits 0:0:0 {{(pid=117670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 18:34:31.073426 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.virt.hardware [None req-41649b9e-f547-488a-90b6-a97b55cc0ffd tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Flavor pref 0:0:0 {{(pid=117670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 18:34:31.074358 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.virt.hardware [None req-41649b9e-f547-488a-90b6-a97b55cc0ffd tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Image pref 0:0:0 {{(pid=117670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 18:34:31.075227 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.virt.hardware [None req-41649b9e-f547-488a-90b6-a97b55cc0ffd tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 18:34:31.126470 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-41649b9e-f547-488a-90b6-a97b55cc0ffd tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:31.127551 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-41649b9e-f547-488a-90b6-a97b55cc0ffd tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:31.128911 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-41649b9e-f547-488a-90b6-a97b55cc0ffd tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:31.129588 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-41649b9e-f547-488a-90b6-a97b55cc0ffd tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:31.157358 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.quota [None req-41649b9e-f547-488a-90b6-a97b55cc0ffd tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Getting quotas for project 4d9f254f568e4bd98b2e4087c3a32c04. Resources: {'instances', 'ram', 'cores'} {{(pid=117670) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 18:34:31.177982 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.quota [None req-41649b9e-f547-488a-90b6-a97b55cc0ffd tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Getting quotas for user 0cc31f4b39704173858410ae52ac2c66 and project 4d9f254f568e4bd98b2e4087c3a32c04. Resources: {'instances', 'ram', 'cores'} {{(pid=117670) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 18:34:31.287523 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-41649b9e-f547-488a-90b6-a97b55cc0ffd tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Going to run 1 instances... {{(pid=117670) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 18:34:31.295791 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-41649b9e-f547-488a-90b6-a97b55cc0ffd tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] [instance: 858d3b02-c17d-4868-8adc-08e94d31c29c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='bab72cae-77de-44ab-a8c7-a1e17c684ff1',volume_size=None,volume_type=None)] {{(pid=117670) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 18:34:31.613680 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-41649b9e-f547-488a-90b6-a97b55cc0ffd tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.772801 Jun 16 18:34:31.623032 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 328/612] 10.222.0.30 () {60 vars in 1146 bytes} [Thu Jun 16 18:34:29 2022] POST /compute/v2.1/servers => generated 405 bytes in 1787 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 18:34:31.636815 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-4de9f81b-1437-4cd3-9d6f-adcc1714b5ab tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:34:31.637993 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-4de9f81b-1437-4cd3-9d6f-adcc1714b5ab tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] [instance: 858d3b02-c17d-4868-8adc-08e94d31c29c] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:34:31.748207 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-4e417d1a-e7e6-4819-853a-b1d022bb62bd tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:34:31.749289 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-4e417d1a-e7e6-4819-853a-b1d022bb62bd tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] [instance: 16226ccb-8bc4-43b6-abd5-7601be0e57b5] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:34:31.779802 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-4e417d1a-e7e6-4819-853a-b1d022bb62bd tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:31.782091 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-4e417d1a-e7e6-4819-853a-b1d022bb62bd tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:31.797091 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-4de9f81b-1437-4cd3-9d6f-adcc1714b5ab tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc31f4b39704173858410ae52ac2c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9f254f568e4bd98b2e4087c3a32c04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:34:31.801643 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-4e417d1a-e7e6-4819-853a-b1d022bb62bd tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:31.803076 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-4e417d1a-e7e6-4819-853a-b1d022bb62bd tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:31.816992 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-4de9f81b-1437-4cd3-9d6f-adcc1714b5ab tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] 10.222.0.30 "GET /compute/v2.1/servers/858d3b02-c17d-4868-8adc-08e94d31c29c" status: 200 len: 1089 microversion: 2.1 time: 0.190333 Jun 16 18:34:31.818726 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 285/613] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:34:31 2022] GET /compute/v2.1/servers/858d3b02-c17d-4868-8adc-08e94d31c29c => generated 1089 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:34:32.279607 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-4e417d1a-e7e6-4819-853a-b1d022bb62bd tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:34:32.304901 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-4e417d1a-e7e6-4819-853a-b1d022bb62bd tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:34:32.306526 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-4e417d1a-e7e6-4819-853a-b1d022bb62bd tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:34:32.308572 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-4e417d1a-e7e6-4819-853a-b1d022bb62bd tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] 10.222.0.30 "GET /compute/v2.1/servers/16226ccb-8bc4-43b6-abd5-7601be0e57b5" status: 200 len: 1737 microversion: 2.20 time: 0.569867 Jun 16 18:34:32.308572 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 329/614] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Jun 16 18:34:31 2022] GET /compute/v2.1/servers/16226ccb-8bc4-43b6-abd5-7601be0e57b5 => generated 1737 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 18:34:32.846038 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-d98e507a-e9c8-4672-985f-993a657a8fa8 tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:34:32.846840 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-d98e507a-e9c8-4672-985f-993a657a8fa8 tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] [instance: 858d3b02-c17d-4868-8adc-08e94d31c29c] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:34:33.044518 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-d98e507a-e9c8-4672-985f-993a657a8fa8 tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc31f4b39704173858410ae52ac2c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9f254f568e4bd98b2e4087c3a32c04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:34:33.059583 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-d98e507a-e9c8-4672-985f-993a657a8fa8 tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] 10.222.0.30 "GET /compute/v2.1/servers/858d3b02-c17d-4868-8adc-08e94d31c29c" status: 200 len: 1089 microversion: 2.1 time: 0.217662 Jun 16 18:34:33.060871 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 286/615] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:34:32 2022] GET /compute/v2.1/servers/858d3b02-c17d-4868-8adc-08e94d31c29c => generated 1089 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:34:33.356466 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-2821f068-312f-4485-8749-2bdddddec01a tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:34:33.358628 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-2821f068-312f-4485-8749-2bdddddec01a tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] [instance: 16226ccb-8bc4-43b6-abd5-7601be0e57b5] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:34:33.411666 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-2821f068-312f-4485-8749-2bdddddec01a tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:33.415018 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-2821f068-312f-4485-8749-2bdddddec01a tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:33.429570 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-2821f068-312f-4485-8749-2bdddddec01a tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:33.459418 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-2821f068-312f-4485-8749-2bdddddec01a tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:34.076669 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-2821f068-312f-4485-8749-2bdddddec01a tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:34:34.097185 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-c231362c-a16c-4be6-9e89-02fb95c53b18 tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:34:34.098478 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-c231362c-a16c-4be6-9e89-02fb95c53b18 tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] [instance: 858d3b02-c17d-4868-8adc-08e94d31c29c] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:34:34.109890 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-2821f068-312f-4485-8749-2bdddddec01a tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:34:34.117825 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-2821f068-312f-4485-8749-2bdddddec01a tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:34:34.121201 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG dbcounter [-] [117671] Writing DB stats nova_api:SELECT=66,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=117671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:34:34.122266 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-2821f068-312f-4485-8749-2bdddddec01a tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] 10.222.0.30 "GET /compute/v2.1/servers/16226ccb-8bc4-43b6-abd5-7601be0e57b5" status: 200 len: 1737 microversion: 2.20 time: 0.777414 Jun 16 18:34:34.124194 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-c231362c-a16c-4be6-9e89-02fb95c53b18 tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:34.126449 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-c231362c-a16c-4be6-9e89-02fb95c53b18 tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:34.127634 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-c231362c-a16c-4be6-9e89-02fb95c53b18 tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:34.128232 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 330/616] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Jun 16 18:34:33 2022] GET /compute/v2.1/servers/16226ccb-8bc4-43b6-abd5-7601be0e57b5 => generated 1737 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 18:34:34.150354 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-c231362c-a16c-4be6-9e89-02fb95c53b18 tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:34.352211 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-c231362c-a16c-4be6-9e89-02fb95c53b18 tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc31f4b39704173858410ae52ac2c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9f254f568e4bd98b2e4087c3a32c04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:34:34.380200 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-c231362c-a16c-4be6-9e89-02fb95c53b18 tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] 10.222.0.30 "GET /compute/v2.1/servers/858d3b02-c17d-4868-8adc-08e94d31c29c" status: 200 len: 1195 microversion: 2.1 time: 0.293526 Jun 16 18:34:34.386334 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 287/617] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:34:34 2022] GET /compute/v2.1/servers/858d3b02-c17d-4868-8adc-08e94d31c29c => generated 1195 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:34:35.150732 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-9bba577a-e0fd-4a97-a35a-0f457329ba34 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:34:35.151926 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-9bba577a-e0fd-4a97-a35a-0f457329ba34 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] [instance: 16226ccb-8bc4-43b6-abd5-7601be0e57b5] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:34:35.194408 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-9bba577a-e0fd-4a97-a35a-0f457329ba34 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:35.195262 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-9bba577a-e0fd-4a97-a35a-0f457329ba34 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:35.196738 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-9bba577a-e0fd-4a97-a35a-0f457329ba34 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:35.197535 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-9bba577a-e0fd-4a97-a35a-0f457329ba34 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:35.419563 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-a2ea0876-12a0-4148-8e0c-24452da9a483 tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:34:35.422228 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-a2ea0876-12a0-4148-8e0c-24452da9a483 tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] [instance: 858d3b02-c17d-4868-8adc-08e94d31c29c] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:34:35.465794 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-a2ea0876-12a0-4148-8e0c-24452da9a483 tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:35.468988 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-a2ea0876-12a0-4148-8e0c-24452da9a483 tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:35.475584 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-a2ea0876-12a0-4148-8e0c-24452da9a483 tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:35.477437 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-a2ea0876-12a0-4148-8e0c-24452da9a483 tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:35.583030 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-a2ea0876-12a0-4148-8e0c-24452da9a483 tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc31f4b39704173858410ae52ac2c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9f254f568e4bd98b2e4087c3a32c04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:34:35.593785 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-a2ea0876-12a0-4148-8e0c-24452da9a483 tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] 10.222.0.30 "GET /compute/v2.1/servers/858d3b02-c17d-4868-8adc-08e94d31c29c" status: 200 len: 1205 microversion: 2.1 time: 0.192889 Jun 16 18:34:35.595091 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 288/618] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:34:35 2022] GET /compute/v2.1/servers/858d3b02-c17d-4868-8adc-08e94d31c29c => generated 1205 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:34:35.891208 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-9bba577a-e0fd-4a97-a35a-0f457329ba34 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:34:35.911587 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-9bba577a-e0fd-4a97-a35a-0f457329ba34 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:34:35.915296 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-9bba577a-e0fd-4a97-a35a-0f457329ba34 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:34:35.921497 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-9bba577a-e0fd-4a97-a35a-0f457329ba34 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] 10.222.0.30 "GET /compute/v2.1/servers/16226ccb-8bc4-43b6-abd5-7601be0e57b5" status: 200 len: 1737 microversion: 2.20 time: 0.777668 Jun 16 18:34:35.936127 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 331/619] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Jun 16 18:34:35 2022] GET /compute/v2.1/servers/16226ccb-8bc4-43b6-abd5-7601be0e57b5 => generated 1737 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:34:36.634530 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-d2a6c6ff-f2a6-4308-9e33-cd95a0829fbb tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:34:36.638906 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-d2a6c6ff-f2a6-4308-9e33-cd95a0829fbb tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] [instance: 858d3b02-c17d-4868-8adc-08e94d31c29c] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:34:36.661346 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-d2a6c6ff-f2a6-4308-9e33-cd95a0829fbb tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:36.668898 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-d2a6c6ff-f2a6-4308-9e33-cd95a0829fbb tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:36.671122 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-d2a6c6ff-f2a6-4308-9e33-cd95a0829fbb tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:36.674622 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-d2a6c6ff-f2a6-4308-9e33-cd95a0829fbb tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:36.851496 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-d2a6c6ff-f2a6-4308-9e33-cd95a0829fbb tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc31f4b39704173858410ae52ac2c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9f254f568e4bd98b2e4087c3a32c04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:34:36.874101 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-d2a6c6ff-f2a6-4308-9e33-cd95a0829fbb tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] 10.222.0.30 "GET /compute/v2.1/servers/858d3b02-c17d-4868-8adc-08e94d31c29c" status: 200 len: 1193 microversion: 2.1 time: 0.246354 Jun 16 18:34:36.876226 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 289/620] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:34:36 2022] GET /compute/v2.1/servers/858d3b02-c17d-4868-8adc-08e94d31c29c => generated 1193 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:34:36.956729 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-52b959e8-ad92-4e31-88ea-e862f6aa67be tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:34:36.961212 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-52b959e8-ad92-4e31-88ea-e862f6aa67be tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] [instance: 16226ccb-8bc4-43b6-abd5-7601be0e57b5] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:34:36.977086 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-52b959e8-ad92-4e31-88ea-e862f6aa67be tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:36.978586 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-52b959e8-ad92-4e31-88ea-e862f6aa67be tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:36.980642 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-52b959e8-ad92-4e31-88ea-e862f6aa67be tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:36.981939 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-52b959e8-ad92-4e31-88ea-e862f6aa67be tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:37.528520 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-52b959e8-ad92-4e31-88ea-e862f6aa67be tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:34:37.540894 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-52b959e8-ad92-4e31-88ea-e862f6aa67be tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:34:37.544791 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-52b959e8-ad92-4e31-88ea-e862f6aa67be tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:34:37.546661 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-52b959e8-ad92-4e31-88ea-e862f6aa67be tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] 10.222.0.30 "GET /compute/v2.1/servers/16226ccb-8bc4-43b6-abd5-7601be0e57b5" status: 200 len: 1737 microversion: 2.20 time: 0.598439 Jun 16 18:34:37.548219 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 332/621] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Jun 16 18:34:36 2022] GET /compute/v2.1/servers/16226ccb-8bc4-43b6-abd5-7601be0e57b5 => generated 1737 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:34:37.910391 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-d150b537-f607-4495-ab07-b58a8d380d72 tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:34:37.920982 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-d150b537-f607-4495-ab07-b58a8d380d72 tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] [instance: 858d3b02-c17d-4868-8adc-08e94d31c29c] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:34:37.955180 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-d150b537-f607-4495-ab07-b58a8d380d72 tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:37.959845 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-d150b537-f607-4495-ab07-b58a8d380d72 tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:37.961806 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-d150b537-f607-4495-ab07-b58a8d380d72 tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:37.967519 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-d150b537-f607-4495-ab07-b58a8d380d72 tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:38.523158 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-d150b537-f607-4495-ab07-b58a8d380d72 tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc31f4b39704173858410ae52ac2c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9f254f568e4bd98b2e4087c3a32c04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:34:38.558762 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-d150b537-f607-4495-ab07-b58a8d380d72 tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] 10.222.0.30 "GET /compute/v2.1/servers/858d3b02-c17d-4868-8adc-08e94d31c29c" status: 200 len: 1260 microversion: 2.1 time: 0.648740 Jun 16 18:34:38.574245 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 290/622] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:34:37 2022] GET /compute/v2.1/servers/858d3b02-c17d-4868-8adc-08e94d31c29c => generated 1260 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:34:38.578602 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-fe4c0898-c3d6-473d-81ff-4453d15e3398 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:34:38.580760 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-fe4c0898-c3d6-473d-81ff-4453d15e3398 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] [instance: 16226ccb-8bc4-43b6-abd5-7601be0e57b5] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:34:38.588560 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG dbcounter [-] [117670] Writing DB stats nova_api:SELECT=63,nova_api:DELETE=1,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=117670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:34:38.601349 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-fe4c0898-c3d6-473d-81ff-4453d15e3398 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:38.602861 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-fe4c0898-c3d6-473d-81ff-4453d15e3398 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:38.604907 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-fe4c0898-c3d6-473d-81ff-4453d15e3398 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:38.606196 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-fe4c0898-c3d6-473d-81ff-4453d15e3398 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:39.099894 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-fe4c0898-c3d6-473d-81ff-4453d15e3398 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:34:39.129382 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-fe4c0898-c3d6-473d-81ff-4453d15e3398 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:34:39.141911 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-fe4c0898-c3d6-473d-81ff-4453d15e3398 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:34:39.144528 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-fe4c0898-c3d6-473d-81ff-4453d15e3398 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] 10.222.0.30 "GET /compute/v2.1/servers/16226ccb-8bc4-43b6-abd5-7601be0e57b5" status: 200 len: 1737 microversion: 2.20 time: 0.572542 Jun 16 18:34:39.147163 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 333/623] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Jun 16 18:34:38 2022] GET /compute/v2.1/servers/16226ccb-8bc4-43b6-abd5-7601be0e57b5 => generated 1737 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 18:34:39.402457 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [req-3d84a830-2b33-4543-8f71-bc944f65f0f5 req-93246048-94bd-4502-a21a-d6da5a0c4481 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "858d3b02-c17d-4868-8adc-08e94d31c29c", "tag": "68356597-c3ad-4071-ac45-b2f7aa7bca35"}]} {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:34:39.434316 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [req-3d84a830-2b33-4543-8f71-bc944f65f0f5 req-93246048-94bd-4502-a21a-d6da5a0c4481 service nova] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:39.435527 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [req-3d84a830-2b33-4543-8f71-bc944f65f0f5 req-93246048-94bd-4502-a21a-d6da5a0c4481 service nova] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:39.463435 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.compute.server_external_events [req-3d84a830-2b33-4543-8f71-bc944f65f0f5 req-93246048-94bd-4502-a21a-d6da5a0c4481 service nova] Creating event network-changed:68356597-c3ad-4071-ac45-b2f7aa7bca35 for instance 858d3b02-c17d-4868-8adc-08e94d31c29c on hv-cinder-81322 Jun 16 18:34:39.480398 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [req-3d84a830-2b33-4543-8f71-bc944f65f0f5 req-93246048-94bd-4502-a21a-d6da5a0c4481 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086993 Jun 16 18:34:39.482213 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 291/624] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Jun 16 18:34:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:34:39.588209 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-3b697d1c-4169-4adb-b8f3-3dbe2ad291f2 tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:34:39.588859 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-3b697d1c-4169-4adb-b8f3-3dbe2ad291f2 tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] [instance: 858d3b02-c17d-4868-8adc-08e94d31c29c] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:34:39.612927 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-3b697d1c-4169-4adb-b8f3-3dbe2ad291f2 tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:39.620318 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-3b697d1c-4169-4adb-b8f3-3dbe2ad291f2 tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:39.622559 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-3b697d1c-4169-4adb-b8f3-3dbe2ad291f2 tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:39.623702 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-3b697d1c-4169-4adb-b8f3-3dbe2ad291f2 tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:40.167245 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-f649b17a-5be0-4e14-b920-d0830075ad75 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:34:40.167981 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-f649b17a-5be0-4e14-b920-d0830075ad75 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] [instance: 16226ccb-8bc4-43b6-abd5-7601be0e57b5] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:34:40.186025 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-f649b17a-5be0-4e14-b920-d0830075ad75 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:40.193709 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-f649b17a-5be0-4e14-b920-d0830075ad75 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:40.194678 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-f649b17a-5be0-4e14-b920-d0830075ad75 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:40.195281 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-f649b17a-5be0-4e14-b920-d0830075ad75 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:40.472247 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-3b697d1c-4169-4adb-b8f3-3dbe2ad291f2 tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc31f4b39704173858410ae52ac2c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9f254f568e4bd98b2e4087c3a32c04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:34:40.486095 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-3b697d1c-4169-4adb-b8f3-3dbe2ad291f2 tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] 10.222.0.30 "GET /compute/v2.1/servers/858d3b02-c17d-4868-8adc-08e94d31c29c" status: 200 len: 1260 microversion: 2.1 time: 0.903396 Jun 16 18:34:40.488288 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 334/625] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:34:39 2022] GET /compute/v2.1/servers/858d3b02-c17d-4868-8adc-08e94d31c29c => generated 1260 bytes in 906 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:34:40.883348 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-f649b17a-5be0-4e14-b920-d0830075ad75 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:34:40.915166 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-f649b17a-5be0-4e14-b920-d0830075ad75 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:34:40.919212 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-f649b17a-5be0-4e14-b920-d0830075ad75 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:34:40.922412 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-f649b17a-5be0-4e14-b920-d0830075ad75 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] 10.222.0.30 "GET /compute/v2.1/servers/16226ccb-8bc4-43b6-abd5-7601be0e57b5" status: 200 len: 1737 microversion: 2.20 time: 0.760356 Jun 16 18:34:40.924578 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 292/626] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Jun 16 18:34:40 2022] GET /compute/v2.1/servers/16226ccb-8bc4-43b6-abd5-7601be0e57b5 => generated 1737 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 18:34:41.526598 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-9be74b34-7488-4e75-8bcd-32dba7dcb10a tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:34:41.527714 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-9be74b34-7488-4e75-8bcd-32dba7dcb10a tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] [instance: 858d3b02-c17d-4868-8adc-08e94d31c29c] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:34:41.539035 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG dbcounter [-] [117670] Writing DB stats nova_cell0:SELECT=2 {{(pid=117670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:34:41.543141 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG dbcounter [-] [117670] Writing DB stats nova_cell0:SELECT=6 {{(pid=117670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:34:41.559591 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-9be74b34-7488-4e75-8bcd-32dba7dcb10a tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:41.560444 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-9be74b34-7488-4e75-8bcd-32dba7dcb10a tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:41.561891 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-9be74b34-7488-4e75-8bcd-32dba7dcb10a tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:41.562644 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-9be74b34-7488-4e75-8bcd-32dba7dcb10a tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:41.938080 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-9be74b34-7488-4e75-8bcd-32dba7dcb10a tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc31f4b39704173858410ae52ac2c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9f254f568e4bd98b2e4087c3a32c04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:34:41.947482 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-159adb6c-0437-4314-8493-efe7e0d8fefe tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:34:41.950703 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-159adb6c-0437-4314-8493-efe7e0d8fefe tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] [instance: 16226ccb-8bc4-43b6-abd5-7601be0e57b5] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:34:41.962393 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-159adb6c-0437-4314-8493-efe7e0d8fefe tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:41.963231 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-159adb6c-0437-4314-8493-efe7e0d8fefe tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:41.964710 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-159adb6c-0437-4314-8493-efe7e0d8fefe tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:41.965378 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-159adb6c-0437-4314-8493-efe7e0d8fefe tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:41.969195 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-9be74b34-7488-4e75-8bcd-32dba7dcb10a tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] 10.222.0.30 "GET /compute/v2.1/servers/858d3b02-c17d-4868-8adc-08e94d31c29c" status: 200 len: 1260 microversion: 2.1 time: 0.457023 Jun 16 18:34:41.988397 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 335/627] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:34:41 2022] GET /compute/v2.1/servers/858d3b02-c17d-4868-8adc-08e94d31c29c => generated 1260 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:34:42.246414 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-159adb6c-0437-4314-8493-efe7e0d8fefe tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:34:42.273689 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-159adb6c-0437-4314-8493-efe7e0d8fefe tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:34:42.278112 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-159adb6c-0437-4314-8493-efe7e0d8fefe tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:34:42.280804 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-159adb6c-0437-4314-8493-efe7e0d8fefe tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] 10.222.0.30 "GET /compute/v2.1/servers/16226ccb-8bc4-43b6-abd5-7601be0e57b5" status: 200 len: 1737 microversion: 2.20 time: 0.338451 Jun 16 18:34:42.284589 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 293/628] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Jun 16 18:34:41 2022] GET /compute/v2.1/servers/16226ccb-8bc4-43b6-abd5-7601be0e57b5 => generated 1737 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 18:34:42.412506 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-405a5479-3d12-4e5c-a4cb-cb0a12154c9f tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Action: 'create', calling method: .version_select at 0x7fbb346f5c10>, body: {"keypair": {"name": "tempest-keypair-1285075105", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP5Llq0F0p5llYNxWj2mug1q5RFWFBFJZFcNTelqXahsvKB+qBHklMTRBceWZPzr0q+m5NLZUDcQNkbEVohHvgRP3+x4lR0Cczt4pcJH32qrLzZtAyimjhxe81psPAcylQ=="}} {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:34:42.447898 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.quota [None req-405a5479-3d12-4e5c-a4cb-cb0a12154c9f tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Getting quotas for project 7a8e1d26bdfc400ebd1e070b09db615e. Resources: {'key_pairs'} {{(pid=117670) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 18:34:42.457564 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.quota [None req-405a5479-3d12-4e5c-a4cb-cb0a12154c9f tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Getting quotas for user ebdf8e3cd1b44dcba37cdcfb4af7db2b and project 7a8e1d26bdfc400ebd1e070b09db615e. Resources: {'key_pairs'} {{(pid=117670) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 18:34:42.519410 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-405a5479-3d12-4e5c-a4cb-cb0a12154c9f tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.286048 Jun 16 18:34:42.520362 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 336/629] 10.222.0.30 () {60 vars in 1158 bytes} [Thu Jun 16 18:34:42 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 18:34:42.789205 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-4d97652a-2384-4d28-b535-9efb804d5d8a tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:34:42.791105 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-4d97652a-2384-4d28-b535-9efb804d5d8a tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] [instance: 3827385c-be20-4887-9735-0e5e54113151] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:34:42.798833 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-4d97652a-2384-4d28-b535-9efb804d5d8a tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:42.800919 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-4d97652a-2384-4d28-b535-9efb804d5d8a tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:42.800919 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-4d97652a-2384-4d28-b535-9efb804d5d8a tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:42.800919 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-4d97652a-2384-4d28-b535-9efb804d5d8a tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:42.906464 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-4d97652a-2384-4d28-b535-9efb804d5d8a tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] 10.222.0.30 "GET /compute/v2.1/servers/3827385c-be20-4887-9735-0e5e54113151/ips" status: 200 len: 149 microversion: 2.1 time: 0.124707 Jun 16 18:34:42.908642 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 294/630] 10.222.0.30 () {58 vars in 1247 bytes} [Thu Jun 16 18:34:42 2022] GET /compute/v2.1/servers/3827385c-be20-4887-9735-0e5e54113151/ips => generated 149 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:34:43.006174 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-39fcaf19-ec40-4218-8697-6f67dddced17 tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:34:43.006816 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-39fcaf19-ec40-4218-8697-6f67dddced17 tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] [instance: 858d3b02-c17d-4868-8adc-08e94d31c29c] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:34:43.016768 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-39fcaf19-ec40-4218-8697-6f67dddced17 tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:43.017242 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-39fcaf19-ec40-4218-8697-6f67dddced17 tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:43.018595 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-39fcaf19-ec40-4218-8697-6f67dddced17 tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:43.019034 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-39fcaf19-ec40-4218-8697-6f67dddced17 tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:43.313410 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-1501aad1-5052-4657-997d-52bc1b8f61b3 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:34:43.314479 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-1501aad1-5052-4657-997d-52bc1b8f61b3 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] [instance: 16226ccb-8bc4-43b6-abd5-7601be0e57b5] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:34:43.319921 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG dbcounter [-] [117671] Writing DB stats nova_cell0:SELECT=4 {{(pid=117671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:34:43.351754 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-1501aad1-5052-4657-997d-52bc1b8f61b3 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:43.352488 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-1501aad1-5052-4657-997d-52bc1b8f61b3 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:43.353505 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-1501aad1-5052-4657-997d-52bc1b8f61b3 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:43.354072 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-1501aad1-5052-4657-997d-52bc1b8f61b3 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:43.506384 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-39fcaf19-ec40-4218-8697-6f67dddced17 tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc31f4b39704173858410ae52ac2c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9f254f568e4bd98b2e4087c3a32c04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:34:43.516477 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-39fcaf19-ec40-4218-8697-6f67dddced17 tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] 10.222.0.30 "GET /compute/v2.1/servers/858d3b02-c17d-4868-8adc-08e94d31c29c" status: 200 len: 1260 microversion: 2.1 time: 0.517721 Jun 16 18:34:43.521300 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 337/631] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:34:42 2022] GET /compute/v2.1/servers/858d3b02-c17d-4868-8adc-08e94d31c29c => generated 1260 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:34:43.703970 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-1501aad1-5052-4657-997d-52bc1b8f61b3 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:34:43.723280 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-1501aad1-5052-4657-997d-52bc1b8f61b3 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:34:43.728668 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-1501aad1-5052-4657-997d-52bc1b8f61b3 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:34:43.731593 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-1501aad1-5052-4657-997d-52bc1b8f61b3 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] 10.222.0.30 "GET /compute/v2.1/servers/16226ccb-8bc4-43b6-abd5-7601be0e57b5" status: 200 len: 1719 microversion: 2.20 time: 0.426948 Jun 16 18:34:43.733664 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 295/632] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Jun 16 18:34:43 2022] GET /compute/v2.1/servers/16226ccb-8bc4-43b6-abd5-7601be0e57b5 => generated 1719 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:34:44.559281 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-04f5cb93-b438-4d50-aae5-fa3bc5f8c887 tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:34:44.560723 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-04f5cb93-b438-4d50-aae5-fa3bc5f8c887 tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] [instance: 858d3b02-c17d-4868-8adc-08e94d31c29c] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:34:44.568924 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-04f5cb93-b438-4d50-aae5-fa3bc5f8c887 tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:44.569731 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-04f5cb93-b438-4d50-aae5-fa3bc5f8c887 tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:44.570846 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-04f5cb93-b438-4d50-aae5-fa3bc5f8c887 tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:44.571535 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-04f5cb93-b438-4d50-aae5-fa3bc5f8c887 tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:44.695835 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-8c316a95-873c-422a-887f-96e111e1b1b2 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e5d3d222-fefa-4aff-952a-8b174d71b446"}} {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:34:44.699802 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-8c316a95-873c-422a-887f-96e111e1b1b2 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] [instance: 3827385c-be20-4887-9735-0e5e54113151] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:34:44.714482 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-8c316a95-873c-422a-887f-96e111e1b1b2 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:44.716135 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-8c316a95-873c-422a-887f-96e111e1b1b2 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:44.719113 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-8c316a95-873c-422a-887f-96e111e1b1b2 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:44.720489 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-8c316a95-873c-422a-887f-96e111e1b1b2 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:45.003483 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-04f5cb93-b438-4d50-aae5-fa3bc5f8c887 tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc31f4b39704173858410ae52ac2c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9f254f568e4bd98b2e4087c3a32c04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:34:45.023598 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-04f5cb93-b438-4d50-aae5-fa3bc5f8c887 tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] 10.222.0.30 "GET /compute/v2.1/servers/858d3b02-c17d-4868-8adc-08e94d31c29c" status: 200 len: 1260 microversion: 2.1 time: 0.467874 Jun 16 18:34:45.033525 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 338/633] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:34:44 2022] GET /compute/v2.1/servers/858d3b02-c17d-4868-8adc-08e94d31c29c => generated 1260 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:34:45.041615 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-316d0761-bc90-4935-9ef7-cbed054e60f8 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:34:45.042804 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-316d0761-bc90-4935-9ef7-cbed054e60f8 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] [instance: 16226ccb-8bc4-43b6-abd5-7601be0e57b5] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:34:45.053907 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-316d0761-bc90-4935-9ef7-cbed054e60f8 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:45.054717 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-316d0761-bc90-4935-9ef7-cbed054e60f8 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:45.056100 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-316d0761-bc90-4935-9ef7-cbed054e60f8 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:45.056795 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-316d0761-bc90-4935-9ef7-cbed054e60f8 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:45.393633 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-316d0761-bc90-4935-9ef7-cbed054e60f8 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:34:45.404931 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-316d0761-bc90-4935-9ef7-cbed054e60f8 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:34:45.406471 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-316d0761-bc90-4935-9ef7-cbed054e60f8 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:34:45.407999 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-316d0761-bc90-4935-9ef7-cbed054e60f8 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] 10.222.0.30 "GET /compute/v2.1/servers/16226ccb-8bc4-43b6-abd5-7601be0e57b5" status: 200 len: 1719 microversion: 2.20 time: 0.373101 Jun 16 18:34:45.408800 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 339/634] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Jun 16 18:34:45 2022] GET /compute/v2.1/servers/16226ccb-8bc4-43b6-abd5-7601be0e57b5 => generated 1719 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:34:45.515159 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-8c316a95-873c-422a-887f-96e111e1b1b2 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] 10.222.0.30 "POST /compute/v2.1/servers/3827385c-be20-4887-9735-0e5e54113151/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.830700 Jun 16 18:34:45.517246 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 296/635] 10.222.0.30 () {60 vars in 1322 bytes} [Thu Jun 16 18:34:44 2022] POST /compute/v2.1/servers/3827385c-be20-4887-9735-0e5e54113151/os-volume_attachments => generated 194 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:34:46.027953 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-2dff2af2-aa89-4e7c-893a-cc59aeb77a51 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1578902019", "imageRef": "38ef083a-a9ff-4836-8954-f770268ba205", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4c5d81c9-e546-4ae0-bf8f-e3bb9c16e4e0"}], "security_groups": [{"name": "tempest-securitygroup--536156987"}], "key_name": "tempest-keypair-1285075105", "user_data": "}} {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:34:46.053051 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-b2599454-e66b-46e8-b224-fbff7e367bf1 tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:34:46.055463 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-b2599454-e66b-46e8-b224-fbff7e367bf1 tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] [instance: 858d3b02-c17d-4868-8adc-08e94d31c29c] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:34:46.070436 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-b2599454-e66b-46e8-b224-fbff7e367bf1 tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:46.071257 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-b2599454-e66b-46e8-b224-fbff7e367bf1 tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:46.072925 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-b2599454-e66b-46e8-b224-fbff7e367bf1 tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:46.073765 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-b2599454-e66b-46e8-b224-fbff7e367bf1 tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:46.248814 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.network.neutron [None req-2dff2af2-aa89-4e7c-893a-cc59aeb77a51 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] validate_networks() for [('4c5d81c9-e546-4ae0-bf8f-e3bb9c16e4e0', None, None, None, None, None)] {{(pid=117670) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 18:34:46.364463 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-b2599454-e66b-46e8-b224-fbff7e367bf1 tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc31f4b39704173858410ae52ac2c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9f254f568e4bd98b2e4087c3a32c04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:34:46.379561 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-b2599454-e66b-46e8-b224-fbff7e367bf1 tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] 10.222.0.30 "GET /compute/v2.1/servers/858d3b02-c17d-4868-8adc-08e94d31c29c" status: 200 len: 1260 microversion: 2.1 time: 0.338204 Jun 16 18:34:46.401578 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 297/636] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:34:46 2022] GET /compute/v2.1/servers/858d3b02-c17d-4868-8adc-08e94d31c29c => generated 1260 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:34:46.442152 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-1d558a18-9c6d-40f1-96b8-5cdfde9ca3a6 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:34:46.445052 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-1d558a18-9c6d-40f1-96b8-5cdfde9ca3a6 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] [instance: 16226ccb-8bc4-43b6-abd5-7601be0e57b5] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:34:46.457763 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-1d558a18-9c6d-40f1-96b8-5cdfde9ca3a6 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:46.459815 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-1d558a18-9c6d-40f1-96b8-5cdfde9ca3a6 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:46.461542 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-1d558a18-9c6d-40f1-96b8-5cdfde9ca3a6 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:46.462443 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-1d558a18-9c6d-40f1-96b8-5cdfde9ca3a6 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:46.505372 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG dbcounter [-] [117671] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:34:46.736655 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-1d558a18-9c6d-40f1-96b8-5cdfde9ca3a6 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:34:46.758620 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-1d558a18-9c6d-40f1-96b8-5cdfde9ca3a6 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:34:46.763065 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-1d558a18-9c6d-40f1-96b8-5cdfde9ca3a6 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:34:46.765784 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-1d558a18-9c6d-40f1-96b8-5cdfde9ca3a6 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] 10.222.0.30 "GET /compute/v2.1/servers/16226ccb-8bc4-43b6-abd5-7601be0e57b5" status: 200 len: 1662 microversion: 2.20 time: 0.332319 Jun 16 18:34:46.767313 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 298/637] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Jun 16 18:34:46 2022] GET /compute/v2.1/servers/16226ccb-8bc4-43b6-abd5-7601be0e57b5 => generated 1662 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 18:34:46.812300 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-02095adb-5df7-4f95-8a38-62e8bdacbac3 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8848ca58-5394-499b-90c8-1828c6e64abf"}} {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:34:46.819405 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-02095adb-5df7-4f95-8a38-62e8bdacbac3 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] [instance: 16226ccb-8bc4-43b6-abd5-7601be0e57b5] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:34:46.837729 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-02095adb-5df7-4f95-8a38-62e8bdacbac3 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:46.844557 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-02095adb-5df7-4f95-8a38-62e8bdacbac3 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:46.845650 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-02095adb-5df7-4f95-8a38-62e8bdacbac3 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:46.846108 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-02095adb-5df7-4f95-8a38-62e8bdacbac3 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:47.049502 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.virt.hardware [None req-2dff2af2-aa89-4e7c-893a-cc59aeb77a51 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Flavor limits 0:0:0 {{(pid=117670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 18:34:47.050567 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.virt.hardware [None req-2dff2af2-aa89-4e7c-893a-cc59aeb77a51 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Image limits 0:0:0 {{(pid=117670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 18:34:47.051785 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.virt.hardware [None req-2dff2af2-aa89-4e7c-893a-cc59aeb77a51 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Flavor pref 0:0:0 {{(pid=117670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 18:34:47.054165 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.virt.hardware [None req-2dff2af2-aa89-4e7c-893a-cc59aeb77a51 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Image pref 0:0:0 {{(pid=117670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 18:34:47.055365 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.virt.hardware [None req-2dff2af2-aa89-4e7c-893a-cc59aeb77a51 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 18:34:47.073204 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-2dff2af2-aa89-4e7c-893a-cc59aeb77a51 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:47.074509 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-2dff2af2-aa89-4e7c-893a-cc59aeb77a51 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:47.076402 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-2dff2af2-aa89-4e7c-893a-cc59aeb77a51 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:47.077518 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-2dff2af2-aa89-4e7c-893a-cc59aeb77a51 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:47.116232 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.quota [None req-2dff2af2-aa89-4e7c-893a-cc59aeb77a51 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Getting quotas for project 7a8e1d26bdfc400ebd1e070b09db615e. Resources: {'instances', 'ram', 'cores'} {{(pid=117670) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 18:34:47.128104 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.quota [None req-2dff2af2-aa89-4e7c-893a-cc59aeb77a51 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Getting quotas for user ebdf8e3cd1b44dcba37cdcfb4af7db2b and project 7a8e1d26bdfc400ebd1e070b09db615e. Resources: {'instances', 'ram', 'cores'} {{(pid=117670) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 18:34:47.160690 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-2dff2af2-aa89-4e7c-893a-cc59aeb77a51 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Going to run 1 instances... {{(pid=117670) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 18:34:47.169760 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-2dff2af2-aa89-4e7c-893a-cc59aeb77a51 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] [instance: f116c8d4-a63e-47e1-bb50-ec64f735bfcc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='38ef083a-a9ff-4836-8954-f770268ba205',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117670) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 18:34:47.286867 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-2dff2af2-aa89-4e7c-893a-cc59aeb77a51 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.262656 Jun 16 18:34:47.299779 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 340/638] 10.222.0.30 () {60 vars in 1146 bytes} [Thu Jun 16 18:34:46 2022] POST /compute/v2.1/servers => generated 401 bytes in 1277 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 18:34:47.482891 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [req-9958f31b-63a0-4e59-9808-a63175ea8ed2 req-f41f7a74-381c-48ad-8626-b7494d6fffa7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16226ccb-8bc4-43b6-abd5-7601be0e57b5", "name": "network-vif-unplugged", "status": "completed", "tag": "fc74ff6c-f681-43e5-ba34-42732de13dac"}]} {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:34:47.497485 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [req-9958f31b-63a0-4e59-9808-a63175ea8ed2 req-f41f7a74-381c-48ad-8626-b7494d6fffa7 service nova] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:47.498923 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [req-9958f31b-63a0-4e59-9808-a63175ea8ed2 req-f41f7a74-381c-48ad-8626-b7494d6fffa7 service nova] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:47.510249 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-02095adb-5df7-4f95-8a38-62e8bdacbac3 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] 10.222.0.30 "POST /compute/v2.1/servers/16226ccb-8bc4-43b6-abd5-7601be0e57b5/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.712615 Jun 16 18:34:47.514094 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 299/639] 10.222.0.30 () {62 vars in 1363 bytes} [Thu Jun 16 18:34:46 2022] POST /compute/v2.1/servers/16226ccb-8bc4-43b6-abd5-7601be0e57b5/os-volume_attachments => generated 188 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 18:34:47.518968 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-22e701af-8944-482f-8a28-a98974ac6cfa tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:34:47.519589 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-22e701af-8944-482f-8a28-a98974ac6cfa tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] [instance: f116c8d4-a63e-47e1-bb50-ec64f735bfcc] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:34:47.531773 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.compute.server_external_events [req-9958f31b-63a0-4e59-9808-a63175ea8ed2 req-f41f7a74-381c-48ad-8626-b7494d6fffa7 service nova] Unable to find a host for instance 16226ccb-8bc4-43b6-abd5-7601be0e57b5. Dropping event network-vif-unplugged {{(pid=117670) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jun 16 18:34:47.533960 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [req-9958f31b-63a0-4e59-9808-a63175ea8ed2 req-f41f7a74-381c-48ad-8626-b7494d6fffa7 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.231561 Jun 16 18:34:47.535715 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 341/640] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Jun 16 18:34:47 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 235 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jun 16 18:34:47.547380 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-fde7506a-26e7-40fa-b519-66edbd63afb5 tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:34:47.548745 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-fde7506a-26e7-40fa-b519-66edbd63afb5 tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] [instance: 858d3b02-c17d-4868-8adc-08e94d31c29c] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:34:47.562394 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-fde7506a-26e7-40fa-b519-66edbd63afb5 tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:47.563286 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-fde7506a-26e7-40fa-b519-66edbd63afb5 tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:47.564943 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-fde7506a-26e7-40fa-b519-66edbd63afb5 tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:47.566502 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-fde7506a-26e7-40fa-b519-66edbd63afb5 tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:47.607738 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG dbcounter [-] [117670] Writing DB stats nova_cell1:SELECT=100 {{(pid=117670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:34:47.657351 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-22e701af-8944-482f-8a28-a98974ac6cfa tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebdf8e3cd1b44dcba37cdcfb4af7db2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a8e1d26bdfc400ebd1e070b09db615e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:34:47.675048 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-22e701af-8944-482f-8a28-a98974ac6cfa tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] 10.222.0.30 "GET /compute/v2.1/servers/f116c8d4-a63e-47e1-bb50-ec64f735bfcc" status: 200 len: 1238 microversion: 2.1 time: 0.159922 Jun 16 18:34:47.678292 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 300/641] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:34:47 2022] GET /compute/v2.1/servers/f116c8d4-a63e-47e1-bb50-ec64f735bfcc => generated 1238 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:34:47.834933 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-2f071abf-1f8d-4266-9735-30b14ff86073 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:34:47.835592 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-2f071abf-1f8d-4266-9735-30b14ff86073 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] [instance: 16226ccb-8bc4-43b6-abd5-7601be0e57b5] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:34:47.846568 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-2f071abf-1f8d-4266-9735-30b14ff86073 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:47.847379 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-2f071abf-1f8d-4266-9735-30b14ff86073 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:47.849012 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-2f071abf-1f8d-4266-9735-30b14ff86073 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:47.851661 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-2f071abf-1f8d-4266-9735-30b14ff86073 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:47.910525 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-fde7506a-26e7-40fa-b519-66edbd63afb5 tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc31f4b39704173858410ae52ac2c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9f254f568e4bd98b2e4087c3a32c04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:34:47.928370 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-fde7506a-26e7-40fa-b519-66edbd63afb5 tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] 10.222.0.30 "GET /compute/v2.1/servers/858d3b02-c17d-4868-8adc-08e94d31c29c" status: 200 len: 1260 microversion: 2.1 time: 0.387937 Jun 16 18:34:47.928370 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 342/642] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:34:47 2022] GET /compute/v2.1/servers/858d3b02-c17d-4868-8adc-08e94d31c29c => generated 1260 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:34:48.300501 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-2f071abf-1f8d-4266-9735-30b14ff86073 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] 10.222.0.30 "DELETE /compute/v2.1/servers/16226ccb-8bc4-43b6-abd5-7601be0e57b5/os-volume_attachments/8848ca58-5394-499b-90c8-1828c6e64abf" status: 202 len: 0 microversion: 2.20 time: 0.472226 Jun 16 18:34:48.301384 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 301/643] 10.222.0.30 () {60 vars in 1456 bytes} [Thu Jun 16 18:34:47 2022] DELETE /compute/v2.1/servers/16226ccb-8bc4-43b6-abd5-7601be0e57b5/os-volume_attachments/8848ca58-5394-499b-90c8-1828c6e64abf => generated 0 bytes in 474 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 16 18:34:48.397116 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-6f413bb8-3325-455f-9f61-e5fea4331ca6 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:34:48.398135 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-6f413bb8-3325-455f-9f61-e5fea4331ca6 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] [instance: 16226ccb-8bc4-43b6-abd5-7601be0e57b5] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:34:48.410562 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-6f413bb8-3325-455f-9f61-e5fea4331ca6 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:48.411422 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-6f413bb8-3325-455f-9f61-e5fea4331ca6 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:48.412840 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-6f413bb8-3325-455f-9f61-e5fea4331ca6 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:48.413620 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-6f413bb8-3325-455f-9f61-e5fea4331ca6 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:48.559633 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-6f413bb8-3325-455f-9f61-e5fea4331ca6 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] 10.222.0.30 "POST /compute/v2.1/servers/16226ccb-8bc4-43b6-abd5-7601be0e57b5/action" status: 202 len: 0 microversion: 2.20 time: 0.170197 Jun 16 18:34:48.564301 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 343/644] 10.222.0.30 () {62 vars in 1318 bytes} [Thu Jun 16 18:34:48 2022] POST /compute/v2.1/servers/16226ccb-8bc4-43b6-abd5-7601be0e57b5/action => generated 0 bytes in 173 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 16 18:34:48.571242 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-7d2f6d9b-880b-4c48-8faf-65ee219f5ac9 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:34:48.571958 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-7d2f6d9b-880b-4c48-8faf-65ee219f5ac9 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] [instance: 16226ccb-8bc4-43b6-abd5-7601be0e57b5] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:34:48.583109 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-7d2f6d9b-880b-4c48-8faf-65ee219f5ac9 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:48.585383 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-7d2f6d9b-880b-4c48-8faf-65ee219f5ac9 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:48.586458 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-7d2f6d9b-880b-4c48-8faf-65ee219f5ac9 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:48.587691 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-7d2f6d9b-880b-4c48-8faf-65ee219f5ac9 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:48.706197 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-a78adb9c-4082-455e-baeb-4982ffee08d1 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:34:48.707252 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-a78adb9c-4082-455e-baeb-4982ffee08d1 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] [instance: f116c8d4-a63e-47e1-bb50-ec64f735bfcc] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:34:48.718543 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-a78adb9c-4082-455e-baeb-4982ffee08d1 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:48.719259 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-a78adb9c-4082-455e-baeb-4982ffee08d1 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:48.720557 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-a78adb9c-4082-455e-baeb-4982ffee08d1 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:48.721567 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-a78adb9c-4082-455e-baeb-4982ffee08d1 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:48.803045 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-7d2f6d9b-880b-4c48-8faf-65ee219f5ac9 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:34:48.816756 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-7d2f6d9b-880b-4c48-8faf-65ee219f5ac9 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:34:48.818828 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-7d2f6d9b-880b-4c48-8faf-65ee219f5ac9 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:34:48.820452 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-7d2f6d9b-880b-4c48-8faf-65ee219f5ac9 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] 10.222.0.30 "GET /compute/v2.1/servers/16226ccb-8bc4-43b6-abd5-7601be0e57b5" status: 200 len: 1670 microversion: 2.20 time: 0.254646 Jun 16 18:34:48.832917 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 302/645] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Jun 16 18:34:48 2022] GET /compute/v2.1/servers/16226ccb-8bc4-43b6-abd5-7601be0e57b5 => generated 1670 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:34:48.896413 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-a78adb9c-4082-455e-baeb-4982ffee08d1 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebdf8e3cd1b44dcba37cdcfb4af7db2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a8e1d26bdfc400ebd1e070b09db615e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:34:48.906196 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-a78adb9c-4082-455e-baeb-4982ffee08d1 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] 10.222.0.30 "GET /compute/v2.1/servers/f116c8d4-a63e-47e1-bb50-ec64f735bfcc" status: 200 len: 1290 microversion: 2.1 time: 0.208508 Jun 16 18:34:48.906874 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 344/646] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:34:48 2022] GET /compute/v2.1/servers/f116c8d4-a63e-47e1-bb50-ec64f735bfcc => generated 1290 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:34:48.955252 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-778c685c-0ea9-4798-8be0-a19d246ff143 tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:34:48.956137 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-778c685c-0ea9-4798-8be0-a19d246ff143 tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] [instance: 858d3b02-c17d-4868-8adc-08e94d31c29c] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:34:48.965735 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-778c685c-0ea9-4798-8be0-a19d246ff143 tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:48.966659 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-778c685c-0ea9-4798-8be0-a19d246ff143 tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:48.968466 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-778c685c-0ea9-4798-8be0-a19d246ff143 tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:48.969816 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-778c685c-0ea9-4798-8be0-a19d246ff143 tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:49.322428 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-778c685c-0ea9-4798-8be0-a19d246ff143 tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc31f4b39704173858410ae52ac2c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9f254f568e4bd98b2e4087c3a32c04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:34:49.354699 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-778c685c-0ea9-4798-8be0-a19d246ff143 tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] 10.222.0.30 "GET /compute/v2.1/servers/858d3b02-c17d-4868-8adc-08e94d31c29c" status: 200 len: 1260 microversion: 2.1 time: 0.405907 Jun 16 18:34:49.360250 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 303/647] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:34:48 2022] GET /compute/v2.1/servers/858d3b02-c17d-4868-8adc-08e94d31c29c => generated 1260 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:34:49.850890 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-a9f10339-8382-4cfa-af3d-c9c257e83d1c tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:34:49.861172 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-a9f10339-8382-4cfa-af3d-c9c257e83d1c tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] [instance: 16226ccb-8bc4-43b6-abd5-7601be0e57b5] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:34:49.881542 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-a9f10339-8382-4cfa-af3d-c9c257e83d1c tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:49.883458 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-a9f10339-8382-4cfa-af3d-c9c257e83d1c tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:49.886587 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-a9f10339-8382-4cfa-af3d-c9c257e83d1c tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:49.888079 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-a9f10339-8382-4cfa-af3d-c9c257e83d1c tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:49.934180 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-70935359-507d-4d49-8609-c2877f3dee17 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:34:49.935284 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-70935359-507d-4d49-8609-c2877f3dee17 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] [instance: f116c8d4-a63e-47e1-bb50-ec64f735bfcc] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:34:49.953880 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-70935359-507d-4d49-8609-c2877f3dee17 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:49.955423 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-70935359-507d-4d49-8609-c2877f3dee17 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:49.957406 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-70935359-507d-4d49-8609-c2877f3dee17 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:49.959016 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-70935359-507d-4d49-8609-c2877f3dee17 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:50.113480 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-70935359-507d-4d49-8609-c2877f3dee17 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebdf8e3cd1b44dcba37cdcfb4af7db2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a8e1d26bdfc400ebd1e070b09db615e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:34:50.129377 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-70935359-507d-4d49-8609-c2877f3dee17 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] 10.222.0.30 "GET /compute/v2.1/servers/f116c8d4-a63e-47e1-bb50-ec64f735bfcc" status: 200 len: 1296 microversion: 2.1 time: 0.200871 Jun 16 18:34:50.130989 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 304/648] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:34:49 2022] GET /compute/v2.1/servers/f116c8d4-a63e-47e1-bb50-ec64f735bfcc => generated 1296 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:34:50.382749 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-06956aaa-e04e-4746-82c6-40927096c1aa tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:34:50.383803 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-06956aaa-e04e-4746-82c6-40927096c1aa tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] [instance: 858d3b02-c17d-4868-8adc-08e94d31c29c] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:34:50.392721 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-06956aaa-e04e-4746-82c6-40927096c1aa tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:50.393639 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-06956aaa-e04e-4746-82c6-40927096c1aa tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:50.394625 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-06956aaa-e04e-4746-82c6-40927096c1aa tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:50.395409 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-06956aaa-e04e-4746-82c6-40927096c1aa tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:50.591064 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-a9f10339-8382-4cfa-af3d-c9c257e83d1c tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:34:50.608783 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-a9f10339-8382-4cfa-af3d-c9c257e83d1c tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:34:50.611101 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-a9f10339-8382-4cfa-af3d-c9c257e83d1c tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:34:50.613520 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-a9f10339-8382-4cfa-af3d-c9c257e83d1c tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] 10.222.0.30 "GET /compute/v2.1/servers/16226ccb-8bc4-43b6-abd5-7601be0e57b5" status: 200 len: 1672 microversion: 2.20 time: 0.775394 Jun 16 18:34:50.614498 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 345/649] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Jun 16 18:34:49 2022] GET /compute/v2.1/servers/16226ccb-8bc4-43b6-abd5-7601be0e57b5 => generated 1672 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:34:50.797852 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-06956aaa-e04e-4746-82c6-40927096c1aa tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc31f4b39704173858410ae52ac2c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9f254f568e4bd98b2e4087c3a32c04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:34:50.819511 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-06956aaa-e04e-4746-82c6-40927096c1aa tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] 10.222.0.30 "GET /compute/v2.1/servers/858d3b02-c17d-4868-8adc-08e94d31c29c" status: 200 len: 1260 microversion: 2.1 time: 0.441522 Jun 16 18:34:50.837804 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 305/650] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:34:50 2022] GET /compute/v2.1/servers/858d3b02-c17d-4868-8adc-08e94d31c29c => generated 1260 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:34:51.160569 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-a7edc640-cd6a-4967-8310-ccc3bef3a6a1 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:34:51.160569 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-a7edc640-cd6a-4967-8310-ccc3bef3a6a1 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] [instance: f116c8d4-a63e-47e1-bb50-ec64f735bfcc] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:34:51.169456 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-a7edc640-cd6a-4967-8310-ccc3bef3a6a1 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:51.170063 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-a7edc640-cd6a-4967-8310-ccc3bef3a6a1 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:51.171284 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-a7edc640-cd6a-4967-8310-ccc3bef3a6a1 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:51.172408 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-a7edc640-cd6a-4967-8310-ccc3bef3a6a1 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:51.308805 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [req-2804cc20-b729-4e40-b69a-4fe6c14773b2 req-bf7ef711-2521-4d0b-aad3-b1c4de93e5b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "858d3b02-c17d-4868-8adc-08e94d31c29c", "name": "network-vif-plugged", "status": "completed", "tag": "68356597-c3ad-4071-ac45-b2f7aa7bca35"}]} {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:34:51.325612 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [req-2804cc20-b729-4e40-b69a-4fe6c14773b2 req-bf7ef711-2521-4d0b-aad3-b1c4de93e5b5 service nova] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:51.326503 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [req-2804cc20-b729-4e40-b69a-4fe6c14773b2 req-bf7ef711-2521-4d0b-aad3-b1c4de93e5b5 service nova] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:51.343245 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.compute.server_external_events [req-2804cc20-b729-4e40-b69a-4fe6c14773b2 req-bf7ef711-2521-4d0b-aad3-b1c4de93e5b5 service nova] Creating event network-vif-plugged:68356597-c3ad-4071-ac45-b2f7aa7bca35 for instance 858d3b02-c17d-4868-8adc-08e94d31c29c on hv-cinder-81322 Jun 16 18:34:51.349815 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [req-2804cc20-b729-4e40-b69a-4fe6c14773b2 req-bf7ef711-2521-4d0b-aad3-b1c4de93e5b5 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045592 Jun 16 18:34:51.351471 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 306/651] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Jun 16 18:34:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:34:51.635598 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-84f67984-98ac-4eef-b77a-8504220d2899 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:34:51.636383 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-84f67984-98ac-4eef-b77a-8504220d2899 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] [instance: 16226ccb-8bc4-43b6-abd5-7601be0e57b5] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:34:51.641417 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-a7edc640-cd6a-4967-8310-ccc3bef3a6a1 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebdf8e3cd1b44dcba37cdcfb4af7db2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a8e1d26bdfc400ebd1e070b09db615e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:34:51.643834 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-84f67984-98ac-4eef-b77a-8504220d2899 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:51.646681 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-84f67984-98ac-4eef-b77a-8504220d2899 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:51.646681 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-84f67984-98ac-4eef-b77a-8504220d2899 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:51.646681 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-84f67984-98ac-4eef-b77a-8504220d2899 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:51.657438 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-a7edc640-cd6a-4967-8310-ccc3bef3a6a1 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] 10.222.0.30 "GET /compute/v2.1/servers/f116c8d4-a63e-47e1-bb50-ec64f735bfcc" status: 200 len: 1363 microversion: 2.1 time: 0.502995 Jun 16 18:34:51.658698 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 346/652] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:34:51 2022] GET /compute/v2.1/servers/f116c8d4-a63e-47e1-bb50-ec64f735bfcc => generated 1363 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:34:51.855608 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-f0d3a82a-10fb-43a3-b2a7-f8e73ae3b68f tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:34:51.856258 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-f0d3a82a-10fb-43a3-b2a7-f8e73ae3b68f tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] [instance: 858d3b02-c17d-4868-8adc-08e94d31c29c] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:34:51.865454 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-f0d3a82a-10fb-43a3-b2a7-f8e73ae3b68f tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:51.867100 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-f0d3a82a-10fb-43a3-b2a7-f8e73ae3b68f tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:51.868295 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-f0d3a82a-10fb-43a3-b2a7-f8e73ae3b68f tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:51.868978 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-f0d3a82a-10fb-43a3-b2a7-f8e73ae3b68f tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:51.919607 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-84f67984-98ac-4eef-b77a-8504220d2899 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:34:51.938809 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-84f67984-98ac-4eef-b77a-8504220d2899 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:34:51.942084 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-84f67984-98ac-4eef-b77a-8504220d2899 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:34:51.960217 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-84f67984-98ac-4eef-b77a-8504220d2899 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] 10.222.0.30 "GET /compute/v2.1/servers/16226ccb-8bc4-43b6-abd5-7601be0e57b5" status: 200 len: 1728 microversion: 2.20 time: 0.324337 Jun 16 18:34:51.984663 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 307/653] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Jun 16 18:34:51 2022] GET /compute/v2.1/servers/16226ccb-8bc4-43b6-abd5-7601be0e57b5 => generated 1728 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 18:34:52.197406 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-f0d3a82a-10fb-43a3-b2a7-f8e73ae3b68f tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc31f4b39704173858410ae52ac2c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9f254f568e4bd98b2e4087c3a32c04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:34:52.209534 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-f0d3a82a-10fb-43a3-b2a7-f8e73ae3b68f tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] 10.222.0.30 "GET /compute/v2.1/servers/858d3b02-c17d-4868-8adc-08e94d31c29c" status: 200 len: 1260 microversion: 2.1 time: 0.356966 Jun 16 18:34:52.211319 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 347/654] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:34:51 2022] GET /compute/v2.1/servers/858d3b02-c17d-4868-8adc-08e94d31c29c => generated 1260 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:34:52.314102 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [req-c18937ce-91cf-4dea-a5a1-fcccea4c592f req-5ffdac24-53c9-4adf-8bfa-534febe74a80 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f116c8d4-a63e-47e1-bb50-ec64f735bfcc", "tag": "897c17d5-5664-4330-a940-38c13c304dca"}]} {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:34:52.332775 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [req-c18937ce-91cf-4dea-a5a1-fcccea4c592f req-5ffdac24-53c9-4adf-8bfa-534febe74a80 service nova] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:52.334074 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [req-c18937ce-91cf-4dea-a5a1-fcccea4c592f req-5ffdac24-53c9-4adf-8bfa-534febe74a80 service nova] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:52.357987 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.compute.server_external_events [req-c18937ce-91cf-4dea-a5a1-fcccea4c592f req-5ffdac24-53c9-4adf-8bfa-534febe74a80 service nova] Creating event network-changed:897c17d5-5664-4330-a940-38c13c304dca for instance f116c8d4-a63e-47e1-bb50-ec64f735bfcc on hv-cinder-81322 Jun 16 18:34:52.365421 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [req-c18937ce-91cf-4dea-a5a1-fcccea4c592f req-5ffdac24-53c9-4adf-8bfa-534febe74a80 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057751 Jun 16 18:34:52.368298 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 308/655] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Jun 16 18:34:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 18:34:52.683089 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-541cf733-f524-4ecc-9413-990a0ec3f02a tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:34:52.684034 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-541cf733-f524-4ecc-9413-990a0ec3f02a tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] [instance: f116c8d4-a63e-47e1-bb50-ec64f735bfcc] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:34:52.693070 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-541cf733-f524-4ecc-9413-990a0ec3f02a tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:52.694354 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-541cf733-f524-4ecc-9413-990a0ec3f02a tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:52.695323 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-541cf733-f524-4ecc-9413-990a0ec3f02a tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:52.696087 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-541cf733-f524-4ecc-9413-990a0ec3f02a tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:53.000874 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-d745903a-4d59-43cf-86b7-038ff4d2c2c9 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:34:53.002195 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-d745903a-4d59-43cf-86b7-038ff4d2c2c9 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] [instance: 16226ccb-8bc4-43b6-abd5-7601be0e57b5] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:34:53.015924 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-d745903a-4d59-43cf-86b7-038ff4d2c2c9 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:53.016794 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-d745903a-4d59-43cf-86b7-038ff4d2c2c9 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:53.026262 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-d745903a-4d59-43cf-86b7-038ff4d2c2c9 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:53.027181 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-d745903a-4d59-43cf-86b7-038ff4d2c2c9 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:53.305294 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-d745903a-4d59-43cf-86b7-038ff4d2c2c9 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:34:53.316949 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-d745903a-4d59-43cf-86b7-038ff4d2c2c9 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:34:53.318693 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-d745903a-4d59-43cf-86b7-038ff4d2c2c9 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:34:53.320380 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-d745903a-4d59-43cf-86b7-038ff4d2c2c9 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] 10.222.0.30 "GET /compute/v2.1/servers/16226ccb-8bc4-43b6-abd5-7601be0e57b5" status: 200 len: 1728 microversion: 2.20 time: 0.327950 Jun 16 18:34:53.321709 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 309/656] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Jun 16 18:34:52 2022] GET /compute/v2.1/servers/16226ccb-8bc4-43b6-abd5-7601be0e57b5 => generated 1728 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 18:34:53.327221 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-709781ba-87fa-40d4-bb15-e2cc2d235015 tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:34:53.328368 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-709781ba-87fa-40d4-bb15-e2cc2d235015 tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] [instance: 858d3b02-c17d-4868-8adc-08e94d31c29c] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:34:53.337323 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-709781ba-87fa-40d4-bb15-e2cc2d235015 tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:53.338217 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-709781ba-87fa-40d4-bb15-e2cc2d235015 tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:53.339579 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-709781ba-87fa-40d4-bb15-e2cc2d235015 tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:53.340570 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-709781ba-87fa-40d4-bb15-e2cc2d235015 tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:53.394493 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-541cf733-f524-4ecc-9413-990a0ec3f02a tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebdf8e3cd1b44dcba37cdcfb4af7db2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a8e1d26bdfc400ebd1e070b09db615e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:34:53.436634 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-541cf733-f524-4ecc-9413-990a0ec3f02a tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] 10.222.0.30 "GET /compute/v2.1/servers/f116c8d4-a63e-47e1-bb50-ec64f735bfcc" status: 200 len: 1363 microversion: 2.1 time: 0.755589 Jun 16 18:34:53.448392 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 348/657] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:34:52 2022] GET /compute/v2.1/servers/f116c8d4-a63e-47e1-bb50-ec64f735bfcc => generated 1363 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:34:53.743021 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-709781ba-87fa-40d4-bb15-e2cc2d235015 tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc31f4b39704173858410ae52ac2c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9f254f568e4bd98b2e4087c3a32c04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:34:53.762027 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-709781ba-87fa-40d4-bb15-e2cc2d235015 tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] 10.222.0.30 "GET /compute/v2.1/servers/858d3b02-c17d-4868-8adc-08e94d31c29c" status: 200 len: 1260 microversion: 2.1 time: 0.438416 Jun 16 18:34:53.763494 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 310/658] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:34:53 2022] GET /compute/v2.1/servers/858d3b02-c17d-4868-8adc-08e94d31c29c => generated 1260 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:34:53.911052 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-3f0ae379-51ba-45f1-a86c-3a26e6360d69 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:34:53.913236 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-3f0ae379-51ba-45f1-a86c-3a26e6360d69 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] [instance: 3827385c-be20-4887-9735-0e5e54113151] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:34:53.920945 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-3f0ae379-51ba-45f1-a86c-3a26e6360d69 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:53.921823 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-3f0ae379-51ba-45f1-a86c-3a26e6360d69 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:53.923103 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-3f0ae379-51ba-45f1-a86c-3a26e6360d69 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:53.923774 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-3f0ae379-51ba-45f1-a86c-3a26e6360d69 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:54.132396 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.objects.instance [None req-3f0ae379-51ba-45f1-a86c-3a26e6360d69 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lazy-loading 'services' on Instance uuid 3827385c-be20-4887-9735-0e5e54113151 {{(pid=117670) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 18:34:54.317134 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-3f0ae379-51ba-45f1-a86c-3a26e6360d69 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] 10.222.0.30 "DELETE /compute/v2.1/servers/3827385c-be20-4887-9735-0e5e54113151/os-volume_attachments/e5d3d222-fefa-4aff-952a-8b174d71b446" status: 202 len: 0 microversion: 2.1 time: 0.426742 Jun 16 18:34:54.328571 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-06bd71ad-3bd1-406a-9930-73488c2808c7 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:34:54.330423 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-06bd71ad-3bd1-406a-9930-73488c2808c7 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] [instance: 3827385c-be20-4887-9735-0e5e54113151] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:34:54.334851 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 349/659] 10.222.0.30 () {58 vars in 1415 bytes} [Thu Jun 16 18:34:53 2022] DELETE /compute/v2.1/servers/3827385c-be20-4887-9735-0e5e54113151/os-volume_attachments/e5d3d222-fefa-4aff-952a-8b174d71b446 => generated 0 bytes in 446 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 18:34:54.339999 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-06bd71ad-3bd1-406a-9930-73488c2808c7 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:54.340860 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-06bd71ad-3bd1-406a-9930-73488c2808c7 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:54.342066 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-06bd71ad-3bd1-406a-9930-73488c2808c7 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:54.342785 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-06bd71ad-3bd1-406a-9930-73488c2808c7 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:54.355149 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-fb007815-910b-4eac-881e-e1474566a002 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:34:54.356647 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-fb007815-910b-4eac-881e-e1474566a002 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] [instance: 16226ccb-8bc4-43b6-abd5-7601be0e57b5] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:34:54.378641 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-fb007815-910b-4eac-881e-e1474566a002 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:54.379393 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-fb007815-910b-4eac-881e-e1474566a002 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:54.381473 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-fb007815-910b-4eac-881e-e1474566a002 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:54.382312 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-fb007815-910b-4eac-881e-e1474566a002 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:54.462127 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-06bd71ad-3bd1-406a-9930-73488c2808c7 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] 10.222.0.30 "GET /compute/v2.1/servers/3827385c-be20-4887-9735-0e5e54113151/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.137373 Jun 16 18:34:54.472209 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 311/660] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Jun 16 18:34:54 2022] GET /compute/v2.1/servers/3827385c-be20-4887-9735-0e5e54113151/os-volume_attachments => generated 197 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:34:54.483814 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-db1a3f31-17e6-4233-8a58-7e97b05b11d3 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:34:54.493176 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-db1a3f31-17e6-4233-8a58-7e97b05b11d3 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] [instance: f116c8d4-a63e-47e1-bb50-ec64f735bfcc] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:34:54.503461 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-db1a3f31-17e6-4233-8a58-7e97b05b11d3 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:54.504245 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-db1a3f31-17e6-4233-8a58-7e97b05b11d3 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:54.506357 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-db1a3f31-17e6-4233-8a58-7e97b05b11d3 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:54.507413 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-db1a3f31-17e6-4233-8a58-7e97b05b11d3 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:54.538165 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG dbcounter [-] [117671] Writing DB stats nova_cell1:SELECT=87,nova_cell1:INSERT=5,nova_cell1:UPDATE=8 {{(pid=117671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:34:54.750352 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-db1a3f31-17e6-4233-8a58-7e97b05b11d3 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebdf8e3cd1b44dcba37cdcfb4af7db2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a8e1d26bdfc400ebd1e070b09db615e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:34:54.763463 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-db1a3f31-17e6-4233-8a58-7e97b05b11d3 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] 10.222.0.30 "GET /compute/v2.1/servers/f116c8d4-a63e-47e1-bb50-ec64f735bfcc" status: 200 len: 1363 microversion: 2.1 time: 0.288675 Jun 16 18:34:54.766276 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 312/661] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:34:54 2022] GET /compute/v2.1/servers/f116c8d4-a63e-47e1-bb50-ec64f735bfcc => generated 1363 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:34:54.778570 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-fb007815-910b-4eac-881e-e1474566a002 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:34:54.795660 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-fb007815-910b-4eac-881e-e1474566a002 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:34:54.796631 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-1a8d803a-696e-4bdc-a9a7-8577d601ba90 tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:34:54.798250 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-1a8d803a-696e-4bdc-a9a7-8577d601ba90 tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] [instance: 858d3b02-c17d-4868-8adc-08e94d31c29c] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:34:54.800296 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-fb007815-910b-4eac-881e-e1474566a002 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:34:54.803500 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-fb007815-910b-4eac-881e-e1474566a002 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] 10.222.0.30 "GET /compute/v2.1/servers/16226ccb-8bc4-43b6-abd5-7601be0e57b5" status: 200 len: 1728 microversion: 2.20 time: 0.452906 Jun 16 18:34:54.805073 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 350/662] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Jun 16 18:34:54 2022] GET /compute/v2.1/servers/16226ccb-8bc4-43b6-abd5-7601be0e57b5 => generated 1728 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:34:54.811692 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-1a8d803a-696e-4bdc-a9a7-8577d601ba90 tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:54.812669 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-1a8d803a-696e-4bdc-a9a7-8577d601ba90 tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:54.814063 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-1a8d803a-696e-4bdc-a9a7-8577d601ba90 tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:54.814956 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-1a8d803a-696e-4bdc-a9a7-8577d601ba90 tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:55.073688 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-1a8d803a-696e-4bdc-a9a7-8577d601ba90 tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc31f4b39704173858410ae52ac2c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9f254f568e4bd98b2e4087c3a32c04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:34:55.093540 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-1a8d803a-696e-4bdc-a9a7-8577d601ba90 tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] 10.222.0.30 "GET /compute/v2.1/servers/858d3b02-c17d-4868-8adc-08e94d31c29c" status: 200 len: 1444 microversion: 2.1 time: 0.303700 Jun 16 18:34:55.109775 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 313/663] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:34:54 2022] GET /compute/v2.1/servers/858d3b02-c17d-4868-8adc-08e94d31c29c => generated 1444 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:34:55.143100 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-4b027d95-9cd4-4ed7-955a-420da6b6bfa2 tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:34:55.144275 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-4b027d95-9cd4-4ed7-955a-420da6b6bfa2 tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] [instance: 858d3b02-c17d-4868-8adc-08e94d31c29c] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:34:55.176739 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-4b027d95-9cd4-4ed7-955a-420da6b6bfa2 tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:55.178084 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-4b027d95-9cd4-4ed7-955a-420da6b6bfa2 tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:55.180260 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-4b027d95-9cd4-4ed7-955a-420da6b6bfa2 tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:55.181058 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-4b027d95-9cd4-4ed7-955a-420da6b6bfa2 tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:55.445980 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-4b027d95-9cd4-4ed7-955a-420da6b6bfa2 tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc31f4b39704173858410ae52ac2c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9f254f568e4bd98b2e4087c3a32c04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:34:55.455739 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-4b027d95-9cd4-4ed7-955a-420da6b6bfa2 tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] 10.222.0.30 "GET /compute/v2.1/servers/858d3b02-c17d-4868-8adc-08e94d31c29c" status: 200 len: 1444 microversion: 2.1 time: 0.330355 Jun 16 18:34:55.456785 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 351/664] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:34:55 2022] GET /compute/v2.1/servers/858d3b02-c17d-4868-8adc-08e94d31c29c => generated 1444 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:34:55.479193 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-9f102ed6-01f5-4b63-a2bc-f23c409bace1 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:34:55.480799 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-9f102ed6-01f5-4b63-a2bc-f23c409bace1 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] [instance: 3827385c-be20-4887-9735-0e5e54113151] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:34:55.488642 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-9f102ed6-01f5-4b63-a2bc-f23c409bace1 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:55.490108 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-9f102ed6-01f5-4b63-a2bc-f23c409bace1 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:55.491272 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-9f102ed6-01f5-4b63-a2bc-f23c409bace1 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:55.491899 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-9f102ed6-01f5-4b63-a2bc-f23c409bace1 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:55.535245 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-9f102ed6-01f5-4b63-a2bc-f23c409bace1 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] 10.222.0.30 "GET /compute/v2.1/servers/3827385c-be20-4887-9735-0e5e54113151/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059760 Jun 16 18:34:55.537345 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 314/665] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Jun 16 18:34:55 2022] GET /compute/v2.1/servers/3827385c-be20-4887-9735-0e5e54113151/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:34:55.791373 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-1249a4fe-e17f-400f-8ce8-9ab3591dfbed tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:34:55.793015 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-1249a4fe-e17f-400f-8ce8-9ab3591dfbed tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] [instance: f116c8d4-a63e-47e1-bb50-ec64f735bfcc] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:34:55.803367 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-1249a4fe-e17f-400f-8ce8-9ab3591dfbed tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:55.804126 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-1249a4fe-e17f-400f-8ce8-9ab3591dfbed tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:55.805201 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-1249a4fe-e17f-400f-8ce8-9ab3591dfbed tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:55.805875 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-1249a4fe-e17f-400f-8ce8-9ab3591dfbed tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:55.827313 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-3812b78a-498a-47e3-8e7c-06df55798282 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:34:55.827942 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-3812b78a-498a-47e3-8e7c-06df55798282 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] [instance: 16226ccb-8bc4-43b6-abd5-7601be0e57b5] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:34:55.840331 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-3812b78a-498a-47e3-8e7c-06df55798282 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:55.841130 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-3812b78a-498a-47e3-8e7c-06df55798282 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:55.842772 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-3812b78a-498a-47e3-8e7c-06df55798282 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:55.843553 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-3812b78a-498a-47e3-8e7c-06df55798282 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:56.085953 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-1249a4fe-e17f-400f-8ce8-9ab3591dfbed tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebdf8e3cd1b44dcba37cdcfb4af7db2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a8e1d26bdfc400ebd1e070b09db615e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:34:56.102961 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-1249a4fe-e17f-400f-8ce8-9ab3591dfbed tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] 10.222.0.30 "GET /compute/v2.1/servers/f116c8d4-a63e-47e1-bb50-ec64f735bfcc" status: 200 len: 1363 microversion: 2.1 time: 0.314513 Jun 16 18:34:56.114293 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 352/666] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:34:55 2022] GET /compute/v2.1/servers/f116c8d4-a63e-47e1-bb50-ec64f735bfcc => generated 1363 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:34:56.438460 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-3812b78a-498a-47e3-8e7c-06df55798282 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:34:56.457543 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-3812b78a-498a-47e3-8e7c-06df55798282 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:34:56.461403 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-3812b78a-498a-47e3-8e7c-06df55798282 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:34:56.463891 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-3812b78a-498a-47e3-8e7c-06df55798282 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] 10.222.0.30 "GET /compute/v2.1/servers/16226ccb-8bc4-43b6-abd5-7601be0e57b5" status: 200 len: 1728 microversion: 2.20 time: 0.640663 Jun 16 18:34:56.465167 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 315/667] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Jun 16 18:34:55 2022] GET /compute/v2.1/servers/16226ccb-8bc4-43b6-abd5-7601be0e57b5 => generated 1728 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 18:34:56.555343 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-445e5723-a26f-4186-bb36-42149356f3d1 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:34:56.557284 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-445e5723-a26f-4186-bb36-42149356f3d1 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] [instance: 3827385c-be20-4887-9735-0e5e54113151] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:34:56.574628 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-445e5723-a26f-4186-bb36-42149356f3d1 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:56.575461 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-445e5723-a26f-4186-bb36-42149356f3d1 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:56.576956 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-445e5723-a26f-4186-bb36-42149356f3d1 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:56.578195 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-445e5723-a26f-4186-bb36-42149356f3d1 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:56.654285 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-445e5723-a26f-4186-bb36-42149356f3d1 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] 10.222.0.30 "GET /compute/v2.1/servers/3827385c-be20-4887-9735-0e5e54113151/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.109997 Jun 16 18:34:56.655918 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 353/668] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Jun 16 18:34:56 2022] GET /compute/v2.1/servers/3827385c-be20-4887-9735-0e5e54113151/os-volume_attachments => generated 197 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:34:57.136655 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-7b4209e0-89a3-4f76-9666-e5dad91069da tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:34:57.139934 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-7b4209e0-89a3-4f76-9666-e5dad91069da tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] [instance: f116c8d4-a63e-47e1-bb50-ec64f735bfcc] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:34:57.154818 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-7b4209e0-89a3-4f76-9666-e5dad91069da tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:57.156106 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-7b4209e0-89a3-4f76-9666-e5dad91069da tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:57.157357 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-7b4209e0-89a3-4f76-9666-e5dad91069da tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:57.158237 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-7b4209e0-89a3-4f76-9666-e5dad91069da tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:57.495120 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-7aa51761-740e-4e18-99a2-2046e0bd3661 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:34:57.495756 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-7aa51761-740e-4e18-99a2-2046e0bd3661 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] [instance: 16226ccb-8bc4-43b6-abd5-7601be0e57b5] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:34:57.510776 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG dbcounter [-] [117670] Writing DB stats nova_cell0:SELECT=2 {{(pid=117670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:34:57.511777 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG dbcounter [-] [117670] Writing DB stats nova_cell0:SELECT=10 {{(pid=117670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:34:57.513420 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-7aa51761-740e-4e18-99a2-2046e0bd3661 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:57.513887 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-7aa51761-740e-4e18-99a2-2046e0bd3661 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:57.515256 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-7aa51761-740e-4e18-99a2-2046e0bd3661 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:57.515256 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-7aa51761-740e-4e18-99a2-2046e0bd3661 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:57.659667 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-7b4209e0-89a3-4f76-9666-e5dad91069da tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebdf8e3cd1b44dcba37cdcfb4af7db2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a8e1d26bdfc400ebd1e070b09db615e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:34:57.681540 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG dbcounter [-] [117671] Writing DB stats nova_cell0:SELECT=2 {{(pid=117671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:34:57.715104 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-7b4209e0-89a3-4f76-9666-e5dad91069da tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] 10.222.0.30 "GET /compute/v2.1/servers/f116c8d4-a63e-47e1-bb50-ec64f735bfcc" status: 200 len: 1363 microversion: 2.1 time: 0.586169 Jun 16 18:34:57.727879 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 316/669] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:34:57 2022] GET /compute/v2.1/servers/f116c8d4-a63e-47e1-bb50-ec64f735bfcc => generated 1363 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:34:57.738273 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-27471ccc-f4ba-48ab-abb4-ea52799a6ce9 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:34:57.740581 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-27471ccc-f4ba-48ab-abb4-ea52799a6ce9 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] [instance: 3827385c-be20-4887-9735-0e5e54113151] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:34:57.753402 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-27471ccc-f4ba-48ab-abb4-ea52799a6ce9 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:57.767813 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-27471ccc-f4ba-48ab-abb4-ea52799a6ce9 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:57.770145 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-27471ccc-f4ba-48ab-abb4-ea52799a6ce9 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:57.771037 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-27471ccc-f4ba-48ab-abb4-ea52799a6ce9 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:57.870007 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-27471ccc-f4ba-48ab-abb4-ea52799a6ce9 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] 10.222.0.30 "GET /compute/v2.1/servers/3827385c-be20-4887-9735-0e5e54113151/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.148617 Jun 16 18:34:57.872011 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 317/670] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Jun 16 18:34:57 2022] GET /compute/v2.1/servers/3827385c-be20-4887-9735-0e5e54113151/os-volume_attachments => generated 197 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:34:57.955587 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-7aa51761-740e-4e18-99a2-2046e0bd3661 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:34:57.971594 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-7aa51761-740e-4e18-99a2-2046e0bd3661 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:34:57.979521 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-7aa51761-740e-4e18-99a2-2046e0bd3661 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:34:57.981033 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-7aa51761-740e-4e18-99a2-2046e0bd3661 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] 10.222.0.30 "GET /compute/v2.1/servers/16226ccb-8bc4-43b6-abd5-7601be0e57b5" status: 200 len: 1728 microversion: 2.20 time: 0.491979 Jun 16 18:34:57.992467 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 354/671] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Jun 16 18:34:57 2022] GET /compute/v2.1/servers/16226ccb-8bc4-43b6-abd5-7601be0e57b5 => generated 1728 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:34:58.736770 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-66c212fb-e553-4b29-a9cf-c0cead623e07 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:34:58.737585 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-66c212fb-e553-4b29-a9cf-c0cead623e07 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] [instance: f116c8d4-a63e-47e1-bb50-ec64f735bfcc] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:34:58.751470 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-66c212fb-e553-4b29-a9cf-c0cead623e07 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:58.751953 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-66c212fb-e553-4b29-a9cf-c0cead623e07 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:58.752834 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-66c212fb-e553-4b29-a9cf-c0cead623e07 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:58.753286 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-66c212fb-e553-4b29-a9cf-c0cead623e07 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:58.890429 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-0a951dd8-63f4-4987-9b05-b87797d63a30 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:34:58.893111 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-0a951dd8-63f4-4987-9b05-b87797d63a30 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] [instance: 3827385c-be20-4887-9735-0e5e54113151] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:34:58.917730 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-0a951dd8-63f4-4987-9b05-b87797d63a30 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:58.919792 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-0a951dd8-63f4-4987-9b05-b87797d63a30 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:58.922987 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-0a951dd8-63f4-4987-9b05-b87797d63a30 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:58.924233 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-0a951dd8-63f4-4987-9b05-b87797d63a30 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:59.017258 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-0a951dd8-63f4-4987-9b05-b87797d63a30 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] 10.222.0.30 "GET /compute/v2.1/servers/3827385c-be20-4887-9735-0e5e54113151/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.133369 Jun 16 18:34:59.024619 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 355/672] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Jun 16 18:34:58 2022] GET /compute/v2.1/servers/3827385c-be20-4887-9735-0e5e54113151/os-volume_attachments => generated 197 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:34:59.039884 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-68ccd819-c516-456b-80a6-4433322a6291 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:34:59.039884 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-68ccd819-c516-456b-80a6-4433322a6291 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] [instance: 16226ccb-8bc4-43b6-abd5-7601be0e57b5] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:34:59.059254 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-68ccd819-c516-456b-80a6-4433322a6291 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:59.060883 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-68ccd819-c516-456b-80a6-4433322a6291 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:59.063718 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-68ccd819-c516-456b-80a6-4433322a6291 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:34:59.064421 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-68ccd819-c516-456b-80a6-4433322a6291 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:34:59.432466 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-68ccd819-c516-456b-80a6-4433322a6291 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:34:59.460870 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-68ccd819-c516-456b-80a6-4433322a6291 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:34:59.466484 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-68ccd819-c516-456b-80a6-4433322a6291 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:34:59.468599 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-68ccd819-c516-456b-80a6-4433322a6291 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] 10.222.0.30 "GET /compute/v2.1/servers/16226ccb-8bc4-43b6-abd5-7601be0e57b5" status: 200 len: 1728 microversion: 2.20 time: 0.447630 Jun 16 18:34:59.469898 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 356/673] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Jun 16 18:34:59 2022] GET /compute/v2.1/servers/16226ccb-8bc4-43b6-abd5-7601be0e57b5 => generated 1728 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:34:59.571091 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-66c212fb-e553-4b29-a9cf-c0cead623e07 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebdf8e3cd1b44dcba37cdcfb4af7db2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a8e1d26bdfc400ebd1e070b09db615e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:34:59.588534 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-66c212fb-e553-4b29-a9cf-c0cead623e07 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] 10.222.0.30 "GET /compute/v2.1/servers/f116c8d4-a63e-47e1-bb50-ec64f735bfcc" status: 200 len: 1363 microversion: 2.1 time: 0.856026 Jun 16 18:34:59.590088 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 318/674] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:34:58 2022] GET /compute/v2.1/servers/f116c8d4-a63e-47e1-bb50-ec64f735bfcc => generated 1363 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:35:00.047722 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-b5988475-9a0f-463f-8674-6b10d2878af4 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:35:00.050872 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-b5988475-9a0f-463f-8674-6b10d2878af4 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] [instance: 3827385c-be20-4887-9735-0e5e54113151] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:35:00.081232 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-b5988475-9a0f-463f-8674-6b10d2878af4 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:35:00.083330 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-b5988475-9a0f-463f-8674-6b10d2878af4 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:35:00.087605 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-b5988475-9a0f-463f-8674-6b10d2878af4 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:35:00.094256 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-b5988475-9a0f-463f-8674-6b10d2878af4 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:35:00.150418 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [req-d10f5acf-dba8-4f40-b6a0-3a3a20be7d58 req-d9fc4fda-e714-4912-8f4c-501fb984c2d6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "858d3b02-c17d-4868-8adc-08e94d31c29c", "tag": "68356597-c3ad-4071-ac45-b2f7aa7bca35"}]} {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:35:00.165658 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [req-d10f5acf-dba8-4f40-b6a0-3a3a20be7d58 req-d9fc4fda-e714-4912-8f4c-501fb984c2d6 service nova] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:35:00.166523 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [req-d10f5acf-dba8-4f40-b6a0-3a3a20be7d58 req-d9fc4fda-e714-4912-8f4c-501fb984c2d6 service nova] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:35:00.182812 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.compute.server_external_events [req-d10f5acf-dba8-4f40-b6a0-3a3a20be7d58 req-d9fc4fda-e714-4912-8f4c-501fb984c2d6 service nova] Creating event network-changed:68356597-c3ad-4071-ac45-b2f7aa7bca35 for instance 858d3b02-c17d-4868-8adc-08e94d31c29c on hv-cinder-81322 Jun 16 18:35:00.189690 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [req-d10f5acf-dba8-4f40-b6a0-3a3a20be7d58 req-d9fc4fda-e714-4912-8f4c-501fb984c2d6 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.285188 Jun 16 18:35:00.191050 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 357/675] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Jun 16 18:34:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 18:35:00.228217 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-b5988475-9a0f-463f-8674-6b10d2878af4 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] 10.222.0.30 "GET /compute/v2.1/servers/3827385c-be20-4887-9735-0e5e54113151/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.198135 Jun 16 18:35:00.229701 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 319/676] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Jun 16 18:35:00 2022] GET /compute/v2.1/servers/3827385c-be20-4887-9735-0e5e54113151/os-volume_attachments => generated 197 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:35:00.498918 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-481ed520-fb4e-4db0-bc8d-9b8b2c5a3383 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:35:00.499819 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-481ed520-fb4e-4db0-bc8d-9b8b2c5a3383 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] [instance: 16226ccb-8bc4-43b6-abd5-7601be0e57b5] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:35:00.514591 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-481ed520-fb4e-4db0-bc8d-9b8b2c5a3383 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:35:00.515304 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-481ed520-fb4e-4db0-bc8d-9b8b2c5a3383 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:35:00.516807 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-481ed520-fb4e-4db0-bc8d-9b8b2c5a3383 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:35:00.516807 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-481ed520-fb4e-4db0-bc8d-9b8b2c5a3383 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:35:00.576222 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG dbcounter [-] [117670] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=117670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:35:00.619940 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-74c758f0-aa0e-4169-b6dc-23cca394f5fb tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:35:00.633267 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-74c758f0-aa0e-4169-b6dc-23cca394f5fb tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] [instance: f116c8d4-a63e-47e1-bb50-ec64f735bfcc] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:35:00.647728 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-74c758f0-aa0e-4169-b6dc-23cca394f5fb tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:35:00.648245 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-74c758f0-aa0e-4169-b6dc-23cca394f5fb tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:35:00.649065 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-74c758f0-aa0e-4169-b6dc-23cca394f5fb tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:35:00.653761 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-74c758f0-aa0e-4169-b6dc-23cca394f5fb tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:35:00.904867 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-481ed520-fb4e-4db0-bc8d-9b8b2c5a3383 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:35:00.938658 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-481ed520-fb4e-4db0-bc8d-9b8b2c5a3383 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:35:00.950360 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-481ed520-fb4e-4db0-bc8d-9b8b2c5a3383 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:35:00.954288 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-481ed520-fb4e-4db0-bc8d-9b8b2c5a3383 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] 10.222.0.30 "GET /compute/v2.1/servers/16226ccb-8bc4-43b6-abd5-7601be0e57b5" status: 200 len: 1728 microversion: 2.20 time: 0.459535 Jun 16 18:35:00.954773 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-74c758f0-aa0e-4169-b6dc-23cca394f5fb tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebdf8e3cd1b44dcba37cdcfb4af7db2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a8e1d26bdfc400ebd1e070b09db615e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:35:00.959339 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 358/677] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Jun 16 18:35:00 2022] GET /compute/v2.1/servers/16226ccb-8bc4-43b6-abd5-7601be0e57b5 => generated 1728 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 18:35:00.966774 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-74c758f0-aa0e-4169-b6dc-23cca394f5fb tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] 10.222.0.30 "GET /compute/v2.1/servers/f116c8d4-a63e-47e1-bb50-ec64f735bfcc" status: 200 len: 1363 microversion: 2.1 time: 0.354564 Jun 16 18:35:00.977955 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 320/678] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:35:00 2022] GET /compute/v2.1/servers/f116c8d4-a63e-47e1-bb50-ec64f735bfcc => generated 1363 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:35:01.248087 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-acbe21ac-7858-4065-948b-5ad5f879a54d tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:35:01.249798 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-acbe21ac-7858-4065-948b-5ad5f879a54d tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] [instance: 3827385c-be20-4887-9735-0e5e54113151] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:35:01.261244 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-acbe21ac-7858-4065-948b-5ad5f879a54d tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:35:01.261747 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-acbe21ac-7858-4065-948b-5ad5f879a54d tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:35:01.263022 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-acbe21ac-7858-4065-948b-5ad5f879a54d tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:35:01.263569 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-acbe21ac-7858-4065-948b-5ad5f879a54d tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:35:01.315338 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-acbe21ac-7858-4065-948b-5ad5f879a54d tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] 10.222.0.30 "GET /compute/v2.1/servers/3827385c-be20-4887-9735-0e5e54113151/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.075833 Jun 16 18:35:01.320285 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 359/679] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Jun 16 18:35:01 2022] GET /compute/v2.1/servers/3827385c-be20-4887-9735-0e5e54113151/os-volume_attachments => generated 197 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 18:35:01.989307 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-6e290394-8680-4c3b-881c-d6f9d214ac05 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:35:01.992744 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-6e290394-8680-4c3b-881c-d6f9d214ac05 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] [instance: f116c8d4-a63e-47e1-bb50-ec64f735bfcc] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:35:02.008798 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-6e290394-8680-4c3b-881c-d6f9d214ac05 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:35:02.010063 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-2276159d-ddce-4626-82d4-ddba37d28673 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:35:02.010792 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-2276159d-ddce-4626-82d4-ddba37d28673 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] [instance: 16226ccb-8bc4-43b6-abd5-7601be0e57b5] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:35:02.012100 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-6e290394-8680-4c3b-881c-d6f9d214ac05 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:35:02.013640 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-6e290394-8680-4c3b-881c-d6f9d214ac05 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:35:02.016870 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-6e290394-8680-4c3b-881c-d6f9d214ac05 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:35:02.023535 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-2276159d-ddce-4626-82d4-ddba37d28673 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:35:02.023988 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-2276159d-ddce-4626-82d4-ddba37d28673 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:35:02.025550 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-2276159d-ddce-4626-82d4-ddba37d28673 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:35:02.026192 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-2276159d-ddce-4626-82d4-ddba37d28673 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:35:02.217710 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-6e290394-8680-4c3b-881c-d6f9d214ac05 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebdf8e3cd1b44dcba37cdcfb4af7db2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a8e1d26bdfc400ebd1e070b09db615e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:35:02.227260 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-6e290394-8680-4c3b-881c-d6f9d214ac05 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] 10.222.0.30 "GET /compute/v2.1/servers/f116c8d4-a63e-47e1-bb50-ec64f735bfcc" status: 200 len: 1363 microversion: 2.1 time: 0.246322 Jun 16 18:35:02.228179 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 321/680] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:35:01 2022] GET /compute/v2.1/servers/f116c8d4-a63e-47e1-bb50-ec64f735bfcc => generated 1363 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:35:02.240672 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-2276159d-ddce-4626-82d4-ddba37d28673 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:35:02.249560 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-2276159d-ddce-4626-82d4-ddba37d28673 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:35:02.251148 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-2276159d-ddce-4626-82d4-ddba37d28673 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:35:02.252428 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-2276159d-ddce-4626-82d4-ddba37d28673 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] 10.222.0.30 "GET /compute/v2.1/servers/16226ccb-8bc4-43b6-abd5-7601be0e57b5" status: 200 len: 1728 microversion: 2.20 time: 0.264945 Jun 16 18:35:02.253009 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 360/681] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Jun 16 18:35:01 2022] GET /compute/v2.1/servers/16226ccb-8bc4-43b6-abd5-7601be0e57b5 => generated 1728 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:35:02.329749 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-36a9a35f-7c49-43d3-a0f4-1c789d789bd1 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:35:02.332664 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-36a9a35f-7c49-43d3-a0f4-1c789d789bd1 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] [instance: 3827385c-be20-4887-9735-0e5e54113151] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:35:02.350100 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-36a9a35f-7c49-43d3-a0f4-1c789d789bd1 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:35:02.350723 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-36a9a35f-7c49-43d3-a0f4-1c789d789bd1 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:35:02.351663 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-36a9a35f-7c49-43d3-a0f4-1c789d789bd1 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:35:02.352535 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-36a9a35f-7c49-43d3-a0f4-1c789d789bd1 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:35:02.399745 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-36a9a35f-7c49-43d3-a0f4-1c789d789bd1 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] 10.222.0.30 "GET /compute/v2.1/servers/3827385c-be20-4887-9735-0e5e54113151/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.075326 Jun 16 18:35:02.400540 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 322/682] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Jun 16 18:35:02 2022] GET /compute/v2.1/servers/3827385c-be20-4887-9735-0e5e54113151/os-volume_attachments => generated 25 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 16 18:35:02.492792 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-9bab9a68-528b-4106-bbbf-d33684db696c tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:35:02.493482 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-9bab9a68-528b-4106-bbbf-d33684db696c tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] [instance: 3827385c-be20-4887-9735-0e5e54113151] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:35:02.500611 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-9bab9a68-528b-4106-bbbf-d33684db696c tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:35:02.501064 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-9bab9a68-528b-4106-bbbf-d33684db696c tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:35:02.501864 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-9bab9a68-528b-4106-bbbf-d33684db696c tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:35:02.502302 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-9bab9a68-528b-4106-bbbf-d33684db696c tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:35:02.553714 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-9bab9a68-528b-4106-bbbf-d33684db696c tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] [instance: 3827385c-be20-4887-9735-0e5e54113151] Going to try to terminate instance {{(pid=117670) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 18:35:02.691342 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-9bab9a68-528b-4106-bbbf-d33684db696c tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] 10.222.0.30 "DELETE /compute/v2.1/servers/3827385c-be20-4887-9735-0e5e54113151" status: 204 len: 0 microversion: 2.1 time: 0.203462 Jun 16 18:35:02.691964 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 361/683] 10.222.0.30 () {58 vars in 1238 bytes} [Thu Jun 16 18:35:02 2022] DELETE /compute/v2.1/servers/3827385c-be20-4887-9735-0e5e54113151 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 18:35:02.702072 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-78cf8919-f0b4-4f2d-8253-9707b4130bdf tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:35:02.702686 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-78cf8919-f0b4-4f2d-8253-9707b4130bdf tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] [instance: 3827385c-be20-4887-9735-0e5e54113151] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:35:02.709870 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-78cf8919-f0b4-4f2d-8253-9707b4130bdf tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:35:02.710363 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-78cf8919-f0b4-4f2d-8253-9707b4130bdf tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:35:02.711160 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-78cf8919-f0b4-4f2d-8253-9707b4130bdf tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:35:02.711600 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-78cf8919-f0b4-4f2d-8253-9707b4130bdf tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:35:02.885667 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-78cf8919-f0b4-4f2d-8253-9707b4130bdf tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f6c755dbf74640a372802f02733eb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f0473c6214a4428be438fabc530012b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:35:02.898757 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-78cf8919-f0b4-4f2d-8253-9707b4130bdf tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] 10.222.0.30 "GET /compute/v2.1/servers/3827385c-be20-4887-9735-0e5e54113151" status: 200 len: 1680 microversion: 2.1 time: 0.200556 Jun 16 18:35:02.899815 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 323/684] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:35:02 2022] GET /compute/v2.1/servers/3827385c-be20-4887-9735-0e5e54113151 => generated 1680 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:35:03.245124 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-b43ae21d-bb51-4919-b224-11e999d1d416 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:35:03.245832 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-b43ae21d-bb51-4919-b224-11e999d1d416 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] [instance: f116c8d4-a63e-47e1-bb50-ec64f735bfcc] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:35:03.254424 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-b43ae21d-bb51-4919-b224-11e999d1d416 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:35:03.256323 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-b43ae21d-bb51-4919-b224-11e999d1d416 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:35:03.257136 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-b43ae21d-bb51-4919-b224-11e999d1d416 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:35:03.257583 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-b43ae21d-bb51-4919-b224-11e999d1d416 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:35:03.279998 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-402a2793-aa99-4bd4-8322-493bcaaf4015 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:35:03.280760 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-402a2793-aa99-4bd4-8322-493bcaaf4015 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] [instance: 16226ccb-8bc4-43b6-abd5-7601be0e57b5] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:35:03.290147 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-402a2793-aa99-4bd4-8322-493bcaaf4015 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:35:03.290589 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-402a2793-aa99-4bd4-8322-493bcaaf4015 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:35:03.291514 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-402a2793-aa99-4bd4-8322-493bcaaf4015 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:35:03.291982 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-402a2793-aa99-4bd4-8322-493bcaaf4015 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:35:03.422979 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-b43ae21d-bb51-4919-b224-11e999d1d416 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebdf8e3cd1b44dcba37cdcfb4af7db2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a8e1d26bdfc400ebd1e070b09db615e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:35:03.432541 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-b43ae21d-bb51-4919-b224-11e999d1d416 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] 10.222.0.30 "GET /compute/v2.1/servers/f116c8d4-a63e-47e1-bb50-ec64f735bfcc" status: 200 len: 1363 microversion: 2.1 time: 0.191589 Jun 16 18:35:03.433143 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 362/685] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:35:03 2022] GET /compute/v2.1/servers/f116c8d4-a63e-47e1-bb50-ec64f735bfcc => generated 1363 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:35:03.441534 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-402a2793-aa99-4bd4-8322-493bcaaf4015 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:35:03.452643 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-402a2793-aa99-4bd4-8322-493bcaaf4015 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:35:03.454320 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-402a2793-aa99-4bd4-8322-493bcaaf4015 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:35:03.455555 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-402a2793-aa99-4bd4-8322-493bcaaf4015 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] 10.222.0.30 "GET /compute/v2.1/servers/16226ccb-8bc4-43b6-abd5-7601be0e57b5" status: 200 len: 1728 microversion: 2.20 time: 0.180530 Jun 16 18:35:03.456148 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 324/686] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Jun 16 18:35:03 2022] GET /compute/v2.1/servers/16226ccb-8bc4-43b6-abd5-7601be0e57b5 => generated 1728 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 18:35:03.918163 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-c5502cb6-2a3b-4153-a3ae-e8e80d3cfcfc tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:35:03.918807 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-c5502cb6-2a3b-4153-a3ae-e8e80d3cfcfc tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] [instance: 3827385c-be20-4887-9735-0e5e54113151] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:35:03.925773 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-c5502cb6-2a3b-4153-a3ae-e8e80d3cfcfc tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:35:03.926225 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-c5502cb6-2a3b-4153-a3ae-e8e80d3cfcfc tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:35:03.927890 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-c5502cb6-2a3b-4153-a3ae-e8e80d3cfcfc tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:35:03.928362 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-c5502cb6-2a3b-4153-a3ae-e8e80d3cfcfc tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:35:04.070226 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-c5502cb6-2a3b-4153-a3ae-e8e80d3cfcfc tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f6c755dbf74640a372802f02733eb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f0473c6214a4428be438fabc530012b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:35:04.078484 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-c5502cb6-2a3b-4153-a3ae-e8e80d3cfcfc tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] 10.222.0.30 "GET /compute/v2.1/servers/3827385c-be20-4887-9735-0e5e54113151" status: 200 len: 1680 microversion: 2.1 time: 0.164178 Jun 16 18:35:04.079063 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 363/687] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:35:03 2022] GET /compute/v2.1/servers/3827385c-be20-4887-9735-0e5e54113151 => generated 1680 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:35:04.449570 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-0932d907-b9c3-444f-8734-d9f5e764a326 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:35:04.450271 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-0932d907-b9c3-444f-8734-d9f5e764a326 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] [instance: f116c8d4-a63e-47e1-bb50-ec64f735bfcc] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:35:04.452807 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG dbcounter [-] [117671] Writing DB stats nova_api:SELECT=78 {{(pid=117671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:35:04.459290 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-0932d907-b9c3-444f-8734-d9f5e764a326 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:35:04.459747 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-0932d907-b9c3-444f-8734-d9f5e764a326 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:35:04.461413 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-0932d907-b9c3-444f-8734-d9f5e764a326 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:35:04.461857 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-0932d907-b9c3-444f-8734-d9f5e764a326 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:35:04.475588 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-98a16b26-b616-4a1c-a6d3-e53484779f7c tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:35:04.476283 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-98a16b26-b616-4a1c-a6d3-e53484779f7c tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] [instance: 16226ccb-8bc4-43b6-abd5-7601be0e57b5] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:35:04.485665 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-98a16b26-b616-4a1c-a6d3-e53484779f7c tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:35:04.486125 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-98a16b26-b616-4a1c-a6d3-e53484779f7c tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:35:04.487318 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-98a16b26-b616-4a1c-a6d3-e53484779f7c tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:35:04.487964 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-98a16b26-b616-4a1c-a6d3-e53484779f7c tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:35:04.625283 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-0932d907-b9c3-444f-8734-d9f5e764a326 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebdf8e3cd1b44dcba37cdcfb4af7db2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a8e1d26bdfc400ebd1e070b09db615e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:35:04.640523 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-0932d907-b9c3-444f-8734-d9f5e764a326 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] 10.222.0.30 "GET /compute/v2.1/servers/f116c8d4-a63e-47e1-bb50-ec64f735bfcc" status: 200 len: 1363 microversion: 2.1 time: 0.194427 Jun 16 18:35:04.641561 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 325/688] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:35:04 2022] GET /compute/v2.1/servers/f116c8d4-a63e-47e1-bb50-ec64f735bfcc => generated 1363 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:35:04.648707 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-98a16b26-b616-4a1c-a6d3-e53484779f7c tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:35:04.657989 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-98a16b26-b616-4a1c-a6d3-e53484779f7c tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:35:04.659495 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-98a16b26-b616-4a1c-a6d3-e53484779f7c tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:35:04.660709 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-98a16b26-b616-4a1c-a6d3-e53484779f7c tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] 10.222.0.30 "GET /compute/v2.1/servers/16226ccb-8bc4-43b6-abd5-7601be0e57b5" status: 200 len: 1728 microversion: 2.20 time: 0.189774 Jun 16 18:35:04.661801 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 364/689] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Jun 16 18:35:04 2022] GET /compute/v2.1/servers/16226ccb-8bc4-43b6-abd5-7601be0e57b5 => generated 1728 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 18:35:05.097844 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-eeaf8c40-986e-47ad-9d47-1567a60e8bce tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:35:05.099513 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-eeaf8c40-986e-47ad-9d47-1567a60e8bce tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] [instance: 3827385c-be20-4887-9735-0e5e54113151] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:35:05.106187 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-eeaf8c40-986e-47ad-9d47-1567a60e8bce tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:35:05.106646 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-eeaf8c40-986e-47ad-9d47-1567a60e8bce tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:35:05.107439 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-eeaf8c40-986e-47ad-9d47-1567a60e8bce tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:35:05.107883 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-eeaf8c40-986e-47ad-9d47-1567a60e8bce tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:35:05.312299 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-eeaf8c40-986e-47ad-9d47-1567a60e8bce tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f6c755dbf74640a372802f02733eb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f0473c6214a4428be438fabc530012b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:35:05.326621 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-eeaf8c40-986e-47ad-9d47-1567a60e8bce tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] 10.222.0.30 "GET /compute/v2.1/servers/3827385c-be20-4887-9735-0e5e54113151" status: 200 len: 1680 microversion: 2.1 time: 0.233442 Jun 16 18:35:05.328718 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 326/690] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:35:05 2022] GET /compute/v2.1/servers/3827385c-be20-4887-9735-0e5e54113151 => generated 1680 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:35:05.673681 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-a77b3cd5-2732-4517-946b-bc0605f82e2c tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:35:05.685132 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-9b34624d-3e25-4de1-9559-cb482fdf0a2c tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:35:05.687552 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-9b34624d-3e25-4de1-9559-cb482fdf0a2c tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] [instance: 16226ccb-8bc4-43b6-abd5-7601be0e57b5] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:35:05.688240 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-a77b3cd5-2732-4517-946b-bc0605f82e2c tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] [instance: f116c8d4-a63e-47e1-bb50-ec64f735bfcc] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:35:05.709889 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-a77b3cd5-2732-4517-946b-bc0605f82e2c tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:35:05.714611 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-9b34624d-3e25-4de1-9559-cb482fdf0a2c tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:35:05.716174 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-a77b3cd5-2732-4517-946b-bc0605f82e2c tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:35:05.717516 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-9b34624d-3e25-4de1-9559-cb482fdf0a2c tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:35:05.719466 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-a77b3cd5-2732-4517-946b-bc0605f82e2c tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:35:05.721483 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-9b34624d-3e25-4de1-9559-cb482fdf0a2c tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:35:05.722778 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-a77b3cd5-2732-4517-946b-bc0605f82e2c tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:35:05.724651 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-9b34624d-3e25-4de1-9559-cb482fdf0a2c tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:35:05.965703 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-9b34624d-3e25-4de1-9559-cb482fdf0a2c tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:35:05.978125 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-9b34624d-3e25-4de1-9559-cb482fdf0a2c tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:35:05.979748 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-9b34624d-3e25-4de1-9559-cb482fdf0a2c tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:35:05.981475 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-9b34624d-3e25-4de1-9559-cb482fdf0a2c tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] 10.222.0.30 "GET /compute/v2.1/servers/16226ccb-8bc4-43b6-abd5-7601be0e57b5" status: 200 len: 1728 microversion: 2.20 time: 0.303654 Jun 16 18:35:05.982487 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 327/691] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Jun 16 18:35:05 2022] GET /compute/v2.1/servers/16226ccb-8bc4-43b6-abd5-7601be0e57b5 => generated 1728 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:35:06.001021 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-a77b3cd5-2732-4517-946b-bc0605f82e2c tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebdf8e3cd1b44dcba37cdcfb4af7db2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a8e1d26bdfc400ebd1e070b09db615e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:35:06.013043 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-a77b3cd5-2732-4517-946b-bc0605f82e2c tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] 10.222.0.30 "GET /compute/v2.1/servers/f116c8d4-a63e-47e1-bb50-ec64f735bfcc" status: 200 len: 1363 microversion: 2.1 time: 0.354963 Jun 16 18:35:06.013740 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 365/692] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:35:05 2022] GET /compute/v2.1/servers/f116c8d4-a63e-47e1-bb50-ec64f735bfcc => generated 1363 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:35:06.346230 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-43918d70-f944-4015-9b48-57f54fb25d1e tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:35:06.346861 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-43918d70-f944-4015-9b48-57f54fb25d1e tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] [instance: 3827385c-be20-4887-9735-0e5e54113151] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:35:06.354441 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-43918d70-f944-4015-9b48-57f54fb25d1e tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:35:06.354851 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-43918d70-f944-4015-9b48-57f54fb25d1e tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:35:06.355439 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-43918d70-f944-4015-9b48-57f54fb25d1e tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:35:06.355915 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-43918d70-f944-4015-9b48-57f54fb25d1e tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:35:06.425361 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-43918d70-f944-4015-9b48-57f54fb25d1e tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f6c755dbf74640a372802f02733eb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f0473c6214a4428be438fabc530012b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:35:06.440546 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-43918d70-f944-4015-9b48-57f54fb25d1e tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] 10.222.0.30 "GET /compute/v2.1/servers/3827385c-be20-4887-9735-0e5e54113151" status: 200 len: 1612 microversion: 2.1 time: 0.098008 Jun 16 18:35:06.447873 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 328/693] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:35:06 2022] GET /compute/v2.1/servers/3827385c-be20-4887-9735-0e5e54113151 => generated 1612 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:35:06.706435 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [req-a0b058c4-5a6d-4f83-9371-4f585731fc98 req-a2f0fa79-50c8-41b9-bfd6-5762c073fbb7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3827385c-be20-4887-9735-0e5e54113151", "name": "network-vif-deleted", "tag": "73b67cf2-c85d-4366-8b42-9ed862d569e5"}]} {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:35:06.714419 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG dbcounter [-] [117670] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=117670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:35:06.737339 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [req-a0b058c4-5a6d-4f83-9371-4f585731fc98 req-a2f0fa79-50c8-41b9-bfd6-5762c073fbb7 service nova] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:35:06.738237 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [req-a0b058c4-5a6d-4f83-9371-4f585731fc98 req-a2f0fa79-50c8-41b9-bfd6-5762c073fbb7 service nova] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:35:06.754579 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.compute.server_external_events [req-a0b058c4-5a6d-4f83-9371-4f585731fc98 req-a2f0fa79-50c8-41b9-bfd6-5762c073fbb7 service nova] Creating event network-vif-deleted:73b67cf2-c85d-4366-8b42-9ed862d569e5 for instance 3827385c-be20-4887-9735-0e5e54113151 on hv-cinder-81322 Jun 16 18:35:06.761816 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [req-a0b058c4-5a6d-4f83-9371-4f585731fc98 req-a2f0fa79-50c8-41b9-bfd6-5762c073fbb7 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058951 Jun 16 18:35:06.762531 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 366/694] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Jun 16 18:35:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 18:35:07.012169 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-adf70bd8-d118-49c7-84e9-9efd9de932d9 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:35:07.013249 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-adf70bd8-d118-49c7-84e9-9efd9de932d9 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] [instance: 16226ccb-8bc4-43b6-abd5-7601be0e57b5] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:35:07.021040 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-adf70bd8-d118-49c7-84e9-9efd9de932d9 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:35:07.021597 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-adf70bd8-d118-49c7-84e9-9efd9de932d9 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:35:07.022516 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-adf70bd8-d118-49c7-84e9-9efd9de932d9 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:35:07.023020 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-adf70bd8-d118-49c7-84e9-9efd9de932d9 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:35:07.027691 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG dbcounter [-] [117671] Writing DB stats nova_cell1:SELECT=100 {{(pid=117671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:35:07.039296 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-7d880073-830a-4daf-b011-e8e322abc2f8 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:35:07.039998 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-7d880073-830a-4daf-b011-e8e322abc2f8 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] [instance: f116c8d4-a63e-47e1-bb50-ec64f735bfcc] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:35:07.046756 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-7d880073-830a-4daf-b011-e8e322abc2f8 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:35:07.047216 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-7d880073-830a-4daf-b011-e8e322abc2f8 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:35:07.048537 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-7d880073-830a-4daf-b011-e8e322abc2f8 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:35:07.048843 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-7d880073-830a-4daf-b011-e8e322abc2f8 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:35:07.256524 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-adf70bd8-d118-49c7-84e9-9efd9de932d9 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:35:07.291338 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-adf70bd8-d118-49c7-84e9-9efd9de932d9 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:35:07.293465 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-adf70bd8-d118-49c7-84e9-9efd9de932d9 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:35:07.295101 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-adf70bd8-d118-49c7-84e9-9efd9de932d9 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] 10.222.0.30 "GET /compute/v2.1/servers/16226ccb-8bc4-43b6-abd5-7601be0e57b5" status: 200 len: 1728 microversion: 2.20 time: 0.288029 Jun 16 18:35:07.295961 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 329/695] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Jun 16 18:35:07 2022] GET /compute/v2.1/servers/16226ccb-8bc4-43b6-abd5-7601be0e57b5 => generated 1728 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:35:07.374483 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-7d880073-830a-4daf-b011-e8e322abc2f8 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebdf8e3cd1b44dcba37cdcfb4af7db2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a8e1d26bdfc400ebd1e070b09db615e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:35:07.378314 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-7d880073-830a-4daf-b011-e8e322abc2f8 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] 10.222.0.30 "GET /compute/v2.1/servers/f116c8d4-a63e-47e1-bb50-ec64f735bfcc" status: 200 len: 1363 microversion: 2.1 time: 0.343090 Jun 16 18:35:07.379274 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 367/696] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:35:07 2022] GET /compute/v2.1/servers/f116c8d4-a63e-47e1-bb50-ec64f735bfcc => generated 1363 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:35:07.471149 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-439ff75c-41f6-470b-a10d-2b6d1dc2482b tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:35:07.474346 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-439ff75c-41f6-470b-a10d-2b6d1dc2482b tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] [instance: 3827385c-be20-4887-9735-0e5e54113151] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:35:07.490055 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-439ff75c-41f6-470b-a10d-2b6d1dc2482b tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:35:07.490865 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-439ff75c-41f6-470b-a10d-2b6d1dc2482b tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:35:07.493566 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-439ff75c-41f6-470b-a10d-2b6d1dc2482b tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:35:07.494471 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-439ff75c-41f6-470b-a10d-2b6d1dc2482b tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:35:07.521969 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.wsgi [None req-439ff75c-41f6-470b-a10d-2b6d1dc2482b tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] HTTP exception thrown: Instance 3827385c-be20-4887-9735-0e5e54113151 could not be found. Jun 16 18:35:07.525939 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-439ff75c-41f6-470b-a10d-2b6d1dc2482b tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Request method failure captured: Jun 16 18:35:07.525939 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: request: GET /compute/v2.1/servers/3827385c-be20-4887-9735-0e5e54113151 HTTP/1.1 Jun 16 18:35:07.525939 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: Accept: application/json Jun 16 18:35:07.525939 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: Accept-Encoding: identity Jun 16 18:35:07.525939 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: Connection: close Jun 16 18:35:07.525939 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: Content-Length: 0 Jun 16 18:35:07.525939 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: Content-Type: application/json Jun 16 18:35:07.525939 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: Host: 10.222.0.30 Jun 16 18:35:07.525939 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: Openstack-System-Scope: None Jun 16 18:35:07.525939 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: User-Agent: python-urllib3/1.26.9 Jun 16 18:35:07.525939 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Auth-Token: gAAAAABiq3ZX0T5cncUq62ubfwO6lq1Lv4hHDbhnjkkOIJCFH6tDdIm4lTs2-IIDJl9nzK-SwFmooLj6i7tKw5uiIiGwCsi7P_mYy-sE7ccdLwqhACdzBDGvbvHDziedNnH_4yw_ULKqsIs-KqEoe_8V5KONSdInylhgSWkEXyoNm7uUe3r64xc Jun 16 18:35:07.525939 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Domain-Id: None Jun 16 18:35:07.525939 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Domain-Name: None Jun 16 18:35:07.525939 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Identity-Status: Confirmed Jun 16 18:35:07.525939 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Is-Admin-Project: True Jun 16 18:35:07.525939 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Project-Domain-Id: default Jun 16 18:35:07.525939 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Project-Domain-Name: Default Jun 16 18:35:07.525939 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Project-Id: 1f0473c6214a4428be438fabc530012b Jun 16 18:35:07.525939 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Project-Name: tempest-AttachVolumeNegativeTest-1927047282 Jun 16 18:35:07.525939 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Role: reader,member Jun 16 18:35:07.525939 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Roles: reader,member Jun 16 18:35:07.527789 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/1f0473c6214a4428be438fabc530012b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/1f0473c6214a4428be438fabc530012b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_1f0473c6214a4428be438fabc530012b", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/1f0473c6214a4428be438fabc530012b"}]}] Jun 16 18:35:07.527789 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Tenant: tempest-AttachVolumeNegativeTest-1927047282 Jun 16 18:35:07.527789 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Tenant-Id: 1f0473c6214a4428be438fabc530012b Jun 16 18:35:07.527789 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1927047282 Jun 16 18:35:07.527789 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-User: tempest-AttachVolumeNegativeTest-1927047282-project Jun 16 18:35:07.527789 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-User-Domain-Id: default Jun 16 18:35:07.527789 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-User-Domain-Name: Default Jun 16 18:35:07.527789 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-User-Id: 89f6c755dbf74640a372802f02733eb3 Jun 16 18:35:07.527789 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-User-Name: tempest-AttachVolumeNegativeTest-1927047282-project Jun 16 18:35:07.527789 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: method: > Jun 16 18:35:07.527789 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: exception: Instance 3827385c-be20-4887-9735-0e5e54113151 could not be found. Jun 16 18:35:07.527789 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: action_args: {'id': '3827385c-be20-4887-9735-0e5e54113151'} Jun 16 18:35:07.528790 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:35:07.528790 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:35:07.528790 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 18:35:07.528790 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 18:35:07.528790 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 18:35:07.528790 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 18:35:07.528790 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 18:35:07.528790 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 18:35:07.528790 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 18:35:07.528790 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 18:35:07.528790 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3827385c-be20-4887-9735-0e5e54113151 could not be found. Jun 16 18:35:07.528790 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Jun 16 18:35:07.528790 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:35:07.528790 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Jun 16 18:35:07.528790 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:35:07.528790 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:35:07.528790 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:35:07.528790 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:35:07.528790 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:35:07.528790 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:35:07.530293 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:35:07.530293 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 18:35:07.530293 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 18:35:07.530293 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 18:35:07.530293 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 18:35:07.530293 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 18:35:07.530293 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:35:07.530293 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3827385c-be20-4887-9735-0e5e54113151 could not be found. Jun 16 18:35:07.530293 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Jun 16 18:35:07.530293 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:35:07.530293 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Jun 16 18:35:07.530293 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:35:07.530293 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:35:07.530293 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:35:07.530293 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:35:07.530293 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:35:07.530293 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3827385c-be20-4887-9735-0e5e54113151 could not be found. Jun 16 18:35:07.530293 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Jun 16 18:35:07.531669 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-439ff75c-41f6-470b-a10d-2b6d1dc2482b tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Returning 404 to user: Instance 3827385c-be20-4887-9735-0e5e54113151 could not be found. {{(pid=117671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:35:07.531669 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-439ff75c-41f6-470b-a10d-2b6d1dc2482b tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] 10.222.0.30 "GET /compute/v2.1/servers/3827385c-be20-4887-9735-0e5e54113151" status: 404 len: 111 microversion: 2.1 time: 0.070843 Jun 16 18:35:07.532261 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 330/697] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:35:07 2022] GET /compute/v2.1/servers/3827385c-be20-4887-9735-0e5e54113151 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:35:07.540845 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-380f409a-93d8-43e5-9507-08c0ad1f197e tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Calling method '.version_select at 0x7fbb23dce3a0>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:35:07.565297 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-380f409a-93d8-43e5-9507-08c0ad1f197e tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-283059063" status: 202 len: 0 microversion: 2.1 time: 0.029588 Jun 16 18:35:07.566148 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 368/698] 10.222.0.30 () {58 vars in 1217 bytes} [Thu Jun 16 18:35:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-283059063 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 16 18:35:08.096609 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [req-191a67ba-28f8-4030-9b18-078f1ce49ea3 req-6e7d8011-3076-4d0a-9398-f7c55406e60d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16226ccb-8bc4-43b6-abd5-7601be0e57b5", "name": "network-vif-plugged", "status": "completed", "tag": "fc74ff6c-f681-43e5-ba34-42732de13dac"}]} {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:35:08.110847 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [req-191a67ba-28f8-4030-9b18-078f1ce49ea3 req-6e7d8011-3076-4d0a-9398-f7c55406e60d service nova] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:35:08.111757 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [req-191a67ba-28f8-4030-9b18-078f1ce49ea3 req-6e7d8011-3076-4d0a-9398-f7c55406e60d service nova] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:35:08.131885 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.compute.server_external_events [req-191a67ba-28f8-4030-9b18-078f1ce49ea3 req-6e7d8011-3076-4d0a-9398-f7c55406e60d service nova] Creating event network-vif-plugged:fc74ff6c-f681-43e5-ba34-42732de13dac for instance 16226ccb-8bc4-43b6-abd5-7601be0e57b5 on hv-cinder-81322 Jun 16 18:35:08.141426 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [req-191a67ba-28f8-4030-9b18-078f1ce49ea3 req-6e7d8011-3076-4d0a-9398-f7c55406e60d service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048738 Jun 16 18:35:08.142555 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 331/699] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Jun 16 18:35:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 18:35:08.318146 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-87e62a1a-beee-41c8-b564-cc1ac6e9a7cd tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:35:08.320070 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-87e62a1a-beee-41c8-b564-cc1ac6e9a7cd tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] [instance: 16226ccb-8bc4-43b6-abd5-7601be0e57b5] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:35:08.328249 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-87e62a1a-beee-41c8-b564-cc1ac6e9a7cd tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:35:08.329121 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-87e62a1a-beee-41c8-b564-cc1ac6e9a7cd tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:35:08.330171 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-87e62a1a-beee-41c8-b564-cc1ac6e9a7cd tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:35:08.330940 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-87e62a1a-beee-41c8-b564-cc1ac6e9a7cd tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:35:08.399784 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-d9929070-dc70-4684-ba08-1efc6d8f1aff tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:35:08.401443 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-d9929070-dc70-4684-ba08-1efc6d8f1aff tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] [instance: f116c8d4-a63e-47e1-bb50-ec64f735bfcc] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:35:08.414255 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-d9929070-dc70-4684-ba08-1efc6d8f1aff tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:35:08.414720 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-d9929070-dc70-4684-ba08-1efc6d8f1aff tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:35:08.415532 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-d9929070-dc70-4684-ba08-1efc6d8f1aff tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:35:08.415977 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-d9929070-dc70-4684-ba08-1efc6d8f1aff tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:35:08.614816 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-d9929070-dc70-4684-ba08-1efc6d8f1aff tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebdf8e3cd1b44dcba37cdcfb4af7db2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a8e1d26bdfc400ebd1e070b09db615e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:35:08.625323 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-d9929070-dc70-4684-ba08-1efc6d8f1aff tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] 10.222.0.30 "GET /compute/v2.1/servers/f116c8d4-a63e-47e1-bb50-ec64f735bfcc" status: 200 len: 1363 microversion: 2.1 time: 0.230732 Jun 16 18:35:08.626131 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 332/700] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:35:08 2022] GET /compute/v2.1/servers/f116c8d4-a63e-47e1-bb50-ec64f735bfcc => generated 1363 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:35:09.042922 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-87e62a1a-beee-41c8-b564-cc1ac6e9a7cd tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:35:09.060655 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-87e62a1a-beee-41c8-b564-cc1ac6e9a7cd tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:35:09.064265 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-87e62a1a-beee-41c8-b564-cc1ac6e9a7cd tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:35:09.066777 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-87e62a1a-beee-41c8-b564-cc1ac6e9a7cd tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] 10.222.0.30 "GET /compute/v2.1/servers/16226ccb-8bc4-43b6-abd5-7601be0e57b5" status: 200 len: 1728 microversion: 2.20 time: 0.752455 Jun 16 18:35:09.068221 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 369/701] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Jun 16 18:35:08 2022] GET /compute/v2.1/servers/16226ccb-8bc4-43b6-abd5-7601be0e57b5 => generated 1728 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 18:35:09.653554 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-0c01ee6b-e41f-4b4d-97e1-a915a16c0578 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:35:09.654091 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-0c01ee6b-e41f-4b4d-97e1-a915a16c0578 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] [instance: f116c8d4-a63e-47e1-bb50-ec64f735bfcc] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:35:09.662125 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-0c01ee6b-e41f-4b4d-97e1-a915a16c0578 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:35:09.662582 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-0c01ee6b-e41f-4b4d-97e1-a915a16c0578 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:35:09.663394 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-0c01ee6b-e41f-4b4d-97e1-a915a16c0578 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:35:09.663828 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-0c01ee6b-e41f-4b4d-97e1-a915a16c0578 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:35:09.828915 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-0c01ee6b-e41f-4b4d-97e1-a915a16c0578 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebdf8e3cd1b44dcba37cdcfb4af7db2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a8e1d26bdfc400ebd1e070b09db615e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:35:09.838558 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-0c01ee6b-e41f-4b4d-97e1-a915a16c0578 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] 10.222.0.30 "GET /compute/v2.1/servers/f116c8d4-a63e-47e1-bb50-ec64f735bfcc" status: 200 len: 1363 microversion: 2.1 time: 0.189044 Jun 16 18:35:09.839306 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 333/702] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:35:09 2022] GET /compute/v2.1/servers/f116c8d4-a63e-47e1-bb50-ec64f735bfcc => generated 1363 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:35:10.087232 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-7be45f75-5d7c-4883-9e12-297567732ddb tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:35:10.087819 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-7be45f75-5d7c-4883-9e12-297567732ddb tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] [instance: 16226ccb-8bc4-43b6-abd5-7601be0e57b5] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:35:10.099621 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-7be45f75-5d7c-4883-9e12-297567732ddb tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:35:10.100719 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-7be45f75-5d7c-4883-9e12-297567732ddb tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:35:10.102148 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-7be45f75-5d7c-4883-9e12-297567732ddb tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:35:10.102969 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-7be45f75-5d7c-4883-9e12-297567732ddb tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:35:10.185465 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [req-ad040534-7707-4942-8429-cc9d3127ff80 req-215ab580-d3dc-4d07-9db1-cae8f4a89441 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f116c8d4-a63e-47e1-bb50-ec64f735bfcc", "name": "network-vif-plugged", "status": "completed", "tag": "897c17d5-5664-4330-a940-38c13c304dca"}]} {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:35:10.202328 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [req-ad040534-7707-4942-8429-cc9d3127ff80 req-215ab580-d3dc-4d07-9db1-cae8f4a89441 service nova] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:35:10.203303 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [req-ad040534-7707-4942-8429-cc9d3127ff80 req-215ab580-d3dc-4d07-9db1-cae8f4a89441 service nova] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:35:10.220378 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.compute.server_external_events [req-ad040534-7707-4942-8429-cc9d3127ff80 req-215ab580-d3dc-4d07-9db1-cae8f4a89441 service nova] Creating event network-vif-plugged:897c17d5-5664-4330-a940-38c13c304dca for instance f116c8d4-a63e-47e1-bb50-ec64f735bfcc on hv-cinder-81322 Jun 16 18:35:10.230711 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [req-ad040534-7707-4942-8429-cc9d3127ff80 req-215ab580-d3dc-4d07-9db1-cae8f4a89441 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052759 Jun 16 18:35:10.232216 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 334/703] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Jun 16 18:35:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:35:10.241931 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-da4aaf51-4b42-42e5-9b58-53ef21f9a449 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:35:10.242963 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-da4aaf51-4b42-42e5-9b58-53ef21f9a449 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] [instance: 3827385c-be20-4887-9735-0e5e54113151] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:35:10.252823 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-da4aaf51-4b42-42e5-9b58-53ef21f9a449 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:35:10.253299 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-da4aaf51-4b42-42e5-9b58-53ef21f9a449 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:35:10.254106 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-da4aaf51-4b42-42e5-9b58-53ef21f9a449 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:35:10.254602 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-da4aaf51-4b42-42e5-9b58-53ef21f9a449 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:35:10.272145 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.wsgi [None req-da4aaf51-4b42-42e5-9b58-53ef21f9a449 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] HTTP exception thrown: Instance 3827385c-be20-4887-9735-0e5e54113151 could not be found. Jun 16 18:35:10.273884 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-da4aaf51-4b42-42e5-9b58-53ef21f9a449 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Request method failure captured: Jun 16 18:35:10.273884 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: request: DELETE /compute/v2.1/servers/3827385c-be20-4887-9735-0e5e54113151 HTTP/1.1 Jun 16 18:35:10.273884 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: Accept: application/json Jun 16 18:35:10.273884 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: Accept-Encoding: identity Jun 16 18:35:10.273884 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: Connection: close Jun 16 18:35:10.273884 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: Content-Length: 0 Jun 16 18:35:10.273884 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: Content-Type: application/json Jun 16 18:35:10.273884 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: Host: 10.222.0.30 Jun 16 18:35:10.273884 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: Openstack-System-Scope: None Jun 16 18:35:10.273884 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: User-Agent: python-urllib3/1.26.9 Jun 16 18:35:10.273884 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Auth-Token: gAAAAABiq3ZX0T5cncUq62ubfwO6lq1Lv4hHDbhnjkkOIJCFH6tDdIm4lTs2-IIDJl9nzK-SwFmooLj6i7tKw5uiIiGwCsi7P_mYy-sE7ccdLwqhACdzBDGvbvHDziedNnH_4yw_ULKqsIs-KqEoe_8V5KONSdInylhgSWkEXyoNm7uUe3r64xc Jun 16 18:35:10.273884 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Domain-Id: None Jun 16 18:35:10.273884 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Domain-Name: None Jun 16 18:35:10.273884 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Identity-Status: Confirmed Jun 16 18:35:10.273884 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Is-Admin-Project: True Jun 16 18:35:10.273884 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Project-Domain-Id: default Jun 16 18:35:10.273884 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Project-Domain-Name: Default Jun 16 18:35:10.273884 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Project-Id: 1f0473c6214a4428be438fabc530012b Jun 16 18:35:10.273884 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Project-Name: tempest-AttachVolumeNegativeTest-1927047282 Jun 16 18:35:10.273884 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Role: reader,member Jun 16 18:35:10.273884 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Roles: reader,member Jun 16 18:35:10.276688 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/1f0473c6214a4428be438fabc530012b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/1f0473c6214a4428be438fabc530012b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_1f0473c6214a4428be438fabc530012b", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/1f0473c6214a4428be438fabc530012b"}]}] Jun 16 18:35:10.276688 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Tenant: tempest-AttachVolumeNegativeTest-1927047282 Jun 16 18:35:10.276688 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Tenant-Id: 1f0473c6214a4428be438fabc530012b Jun 16 18:35:10.276688 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1927047282 Jun 16 18:35:10.276688 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-User: tempest-AttachVolumeNegativeTest-1927047282-project Jun 16 18:35:10.276688 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-User-Domain-Id: default Jun 16 18:35:10.276688 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-User-Domain-Name: Default Jun 16 18:35:10.276688 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-User-Id: 89f6c755dbf74640a372802f02733eb3 Jun 16 18:35:10.276688 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-User-Name: tempest-AttachVolumeNegativeTest-1927047282-project Jun 16 18:35:10.276688 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: method: > Jun 16 18:35:10.276688 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: exception: Instance 3827385c-be20-4887-9735-0e5e54113151 could not be found. Jun 16 18:35:10.276688 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: action_args: {'id': '3827385c-be20-4887-9735-0e5e54113151'} Jun 16 18:35:10.278120 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:35:10.278120 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:35:10.278120 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 18:35:10.278120 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 18:35:10.278120 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 18:35:10.278120 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 18:35:10.278120 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 18:35:10.278120 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 18:35:10.278120 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 18:35:10.278120 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 18:35:10.278120 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3827385c-be20-4887-9735-0e5e54113151 could not be found. Jun 16 18:35:10.278120 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Jun 16 18:35:10.278120 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:35:10.278120 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Jun 16 18:35:10.278120 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:35:10.278120 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:35:10.278120 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:35:10.278120 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:35:10.278120 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:35:10.278120 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:35:10.280646 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:35:10.280646 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 16 18:35:10.280646 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 16 18:35:10.280646 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 16 18:35:10.280646 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 16 18:35:10.280646 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 18:35:10.280646 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 18:35:10.280646 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 18:35:10.280646 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:35:10.280646 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3827385c-be20-4887-9735-0e5e54113151 could not be found. Jun 16 18:35:10.280646 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Jun 16 18:35:10.280646 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:35:10.280646 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Jun 16 18:35:10.280646 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:35:10.280646 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:35:10.280646 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:35:10.280646 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:35:10.280646 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:35:10.280646 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3827385c-be20-4887-9735-0e5e54113151 could not be found. Jun 16 18:35:10.280646 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Jun 16 18:35:10.283492 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-da4aaf51-4b42-42e5-9b58-53ef21f9a449 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Returning 404 to user: Instance 3827385c-be20-4887-9735-0e5e54113151 could not be found. {{(pid=117671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:35:10.283492 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-da4aaf51-4b42-42e5-9b58-53ef21f9a449 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] 10.222.0.30 "DELETE /compute/v2.1/servers/3827385c-be20-4887-9735-0e5e54113151" status: 404 len: 111 microversion: 2.1 time: 0.041088 Jun 16 18:35:10.283492 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 335/704] 10.222.0.30 () {58 vars in 1238 bytes} [Thu Jun 16 18:35:10 2022] DELETE /compute/v2.1/servers/3827385c-be20-4887-9735-0e5e54113151 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:35:10.301053 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-ffb0e24b-1e99-4650-9e02-c1119c358710 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:35:10.302845 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-ffb0e24b-1e99-4650-9e02-c1119c358710 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] [instance: 3827385c-be20-4887-9735-0e5e54113151] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:35:10.313339 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-ffb0e24b-1e99-4650-9e02-c1119c358710 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:35:10.314120 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-ffb0e24b-1e99-4650-9e02-c1119c358710 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:35:10.315275 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-ffb0e24b-1e99-4650-9e02-c1119c358710 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:35:10.315912 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-ffb0e24b-1e99-4650-9e02-c1119c358710 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:35:10.338219 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.wsgi [None req-ffb0e24b-1e99-4650-9e02-c1119c358710 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] HTTP exception thrown: Instance 3827385c-be20-4887-9735-0e5e54113151 could not be found. Jun 16 18:35:10.341264 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-ffb0e24b-1e99-4650-9e02-c1119c358710 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Request method failure captured: Jun 16 18:35:10.341264 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: request: GET /compute/v2.1/servers/3827385c-be20-4887-9735-0e5e54113151 HTTP/1.1 Jun 16 18:35:10.341264 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: Accept: application/json Jun 16 18:35:10.341264 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: Accept-Encoding: identity Jun 16 18:35:10.341264 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: Connection: close Jun 16 18:35:10.341264 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: Content-Length: 0 Jun 16 18:35:10.341264 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: Content-Type: application/json Jun 16 18:35:10.341264 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: Host: 10.222.0.30 Jun 16 18:35:10.341264 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: Openstack-System-Scope: None Jun 16 18:35:10.341264 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: User-Agent: python-urllib3/1.26.9 Jun 16 18:35:10.341264 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Auth-Token: gAAAAABiq3ZX0T5cncUq62ubfwO6lq1Lv4hHDbhnjkkOIJCFH6tDdIm4lTs2-IIDJl9nzK-SwFmooLj6i7tKw5uiIiGwCsi7P_mYy-sE7ccdLwqhACdzBDGvbvHDziedNnH_4yw_ULKqsIs-KqEoe_8V5KONSdInylhgSWkEXyoNm7uUe3r64xc Jun 16 18:35:10.341264 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Domain-Id: None Jun 16 18:35:10.341264 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Domain-Name: None Jun 16 18:35:10.341264 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Identity-Status: Confirmed Jun 16 18:35:10.341264 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Is-Admin-Project: True Jun 16 18:35:10.341264 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Project-Domain-Id: default Jun 16 18:35:10.341264 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Project-Domain-Name: Default Jun 16 18:35:10.341264 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Project-Id: 1f0473c6214a4428be438fabc530012b Jun 16 18:35:10.341264 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Project-Name: tempest-AttachVolumeNegativeTest-1927047282 Jun 16 18:35:10.341264 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Role: reader,member Jun 16 18:35:10.341264 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Roles: reader,member Jun 16 18:35:10.349517 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/1f0473c6214a4428be438fabc530012b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/1f0473c6214a4428be438fabc530012b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_1f0473c6214a4428be438fabc530012b", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/1f0473c6214a4428be438fabc530012b"}]}] Jun 16 18:35:10.349517 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Tenant: tempest-AttachVolumeNegativeTest-1927047282 Jun 16 18:35:10.349517 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Tenant-Id: 1f0473c6214a4428be438fabc530012b Jun 16 18:35:10.349517 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1927047282 Jun 16 18:35:10.349517 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-User: tempest-AttachVolumeNegativeTest-1927047282-project Jun 16 18:35:10.349517 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-User-Domain-Id: default Jun 16 18:35:10.349517 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-User-Domain-Name: Default Jun 16 18:35:10.349517 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-User-Id: 89f6c755dbf74640a372802f02733eb3 Jun 16 18:35:10.349517 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-User-Name: tempest-AttachVolumeNegativeTest-1927047282-project Jun 16 18:35:10.349517 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: method: > Jun 16 18:35:10.349517 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: exception: Instance 3827385c-be20-4887-9735-0e5e54113151 could not be found. Jun 16 18:35:10.349517 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: action_args: {'id': '3827385c-be20-4887-9735-0e5e54113151'} Jun 16 18:35:10.351620 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:35:10.351620 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:35:10.351620 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 18:35:10.351620 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 18:35:10.351620 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 18:35:10.351620 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 18:35:10.351620 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 18:35:10.351620 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 18:35:10.351620 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 18:35:10.351620 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 18:35:10.351620 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3827385c-be20-4887-9735-0e5e54113151 could not be found. Jun 16 18:35:10.351620 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Jun 16 18:35:10.351620 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:35:10.351620 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Jun 16 18:35:10.351620 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:35:10.351620 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:35:10.351620 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:35:10.351620 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:35:10.351620 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:35:10.351620 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:35:10.354466 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:35:10.354466 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 18:35:10.354466 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 18:35:10.354466 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 18:35:10.354466 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 18:35:10.354466 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 18:35:10.354466 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:35:10.354466 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3827385c-be20-4887-9735-0e5e54113151 could not be found. Jun 16 18:35:10.354466 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Jun 16 18:35:10.354466 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:35:10.354466 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Jun 16 18:35:10.354466 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:35:10.354466 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:35:10.354466 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:35:10.354466 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:35:10.354466 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:35:10.354466 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3827385c-be20-4887-9735-0e5e54113151 could not be found. Jun 16 18:35:10.354466 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Jun 16 18:35:10.357722 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-ffb0e24b-1e99-4650-9e02-c1119c358710 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Returning 404 to user: Instance 3827385c-be20-4887-9735-0e5e54113151 could not be found. {{(pid=117671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:35:10.357722 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-ffb0e24b-1e99-4650-9e02-c1119c358710 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] 10.222.0.30 "GET /compute/v2.1/servers/3827385c-be20-4887-9735-0e5e54113151" status: 404 len: 111 microversion: 2.1 time: 0.053602 Jun 16 18:35:10.357722 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 336/705] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:35:10 2022] GET /compute/v2.1/servers/3827385c-be20-4887-9735-0e5e54113151 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:35:10.364759 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-7be45f75-5d7c-4883-9e12-297567732ddb tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:35:10.377752 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-7be45f75-5d7c-4883-9e12-297567732ddb tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:35:10.380290 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-7be45f75-5d7c-4883-9e12-297567732ddb tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:35:10.381928 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-7be45f75-5d7c-4883-9e12-297567732ddb tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] 10.222.0.30 "GET /compute/v2.1/servers/16226ccb-8bc4-43b6-abd5-7601be0e57b5" status: 200 len: 1728 microversion: 2.20 time: 0.299293 Jun 16 18:35:10.382737 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 370/706] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Jun 16 18:35:10 2022] GET /compute/v2.1/servers/16226ccb-8bc4-43b6-abd5-7601be0e57b5 => generated 1728 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 18:35:10.863195 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-068a3da8-787f-4525-9ce0-a873a3833faa tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:35:10.865324 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-068a3da8-787f-4525-9ce0-a873a3833faa tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] [instance: f116c8d4-a63e-47e1-bb50-ec64f735bfcc] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:35:10.878083 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-068a3da8-787f-4525-9ce0-a873a3833faa tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:35:10.878908 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-068a3da8-787f-4525-9ce0-a873a3833faa tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:35:10.881362 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-068a3da8-787f-4525-9ce0-a873a3833faa tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:35:10.882447 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-068a3da8-787f-4525-9ce0-a873a3833faa tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:35:11.099223 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-068a3da8-787f-4525-9ce0-a873a3833faa tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebdf8e3cd1b44dcba37cdcfb4af7db2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a8e1d26bdfc400ebd1e070b09db615e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:35:11.107714 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-068a3da8-787f-4525-9ce0-a873a3833faa tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] 10.222.0.30 "GET /compute/v2.1/servers/f116c8d4-a63e-47e1-bb50-ec64f735bfcc" status: 200 len: 1363 microversion: 2.1 time: 0.252085 Jun 16 18:35:11.108351 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 337/707] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:35:10 2022] GET /compute/v2.1/servers/f116c8d4-a63e-47e1-bb50-ec64f735bfcc => generated 1363 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:35:11.410808 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-b1a4fc67-f65e-4ae6-8e18-c9a779e517ea tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:35:11.412537 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-b1a4fc67-f65e-4ae6-8e18-c9a779e517ea tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] [instance: 16226ccb-8bc4-43b6-abd5-7601be0e57b5] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:35:11.419692 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-b1a4fc67-f65e-4ae6-8e18-c9a779e517ea tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:35:11.420165 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-b1a4fc67-f65e-4ae6-8e18-c9a779e517ea tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:35:11.420938 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-b1a4fc67-f65e-4ae6-8e18-c9a779e517ea tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:35:11.421371 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-b1a4fc67-f65e-4ae6-8e18-c9a779e517ea tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:35:11.564351 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-e8167264-0da9-46f4-87f9-186d2e32cd7d tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:35:11.565145 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-e8167264-0da9-46f4-87f9-186d2e32cd7d tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] [instance: e5de32bc-4cf2-47cd-b0de-bcc77b9a5791] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:35:11.574268 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-e8167264-0da9-46f4-87f9-186d2e32cd7d tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:35:11.574872 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-e8167264-0da9-46f4-87f9-186d2e32cd7d tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:35:11.575919 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-e8167264-0da9-46f4-87f9-186d2e32cd7d tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:35:11.576683 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-e8167264-0da9-46f4-87f9-186d2e32cd7d tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:35:11.594851 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.wsgi [None req-e8167264-0da9-46f4-87f9-186d2e32cd7d tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] HTTP exception thrown: Instance e5de32bc-4cf2-47cd-b0de-bcc77b9a5791 could not be found. Jun 16 18:35:11.596756 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-e8167264-0da9-46f4-87f9-186d2e32cd7d tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Request method failure captured: Jun 16 18:35:11.596756 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: request: DELETE /compute/v2.1/servers/e5de32bc-4cf2-47cd-b0de-bcc77b9a5791 HTTP/1.1 Jun 16 18:35:11.596756 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: Accept: application/json Jun 16 18:35:11.596756 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: Accept-Encoding: identity Jun 16 18:35:11.596756 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: Connection: close Jun 16 18:35:11.596756 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: Content-Length: 0 Jun 16 18:35:11.596756 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: Content-Type: application/json Jun 16 18:35:11.596756 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: Host: 10.222.0.30 Jun 16 18:35:11.596756 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: Openstack-System-Scope: None Jun 16 18:35:11.596756 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: User-Agent: python-urllib3/1.26.9 Jun 16 18:35:11.596756 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Auth-Token: gAAAAABiq3ZX0T5cncUq62ubfwO6lq1Lv4hHDbhnjkkOIJCFH6tDdIm4lTs2-IIDJl9nzK-SwFmooLj6i7tKw5uiIiGwCsi7P_mYy-sE7ccdLwqhACdzBDGvbvHDziedNnH_4yw_ULKqsIs-KqEoe_8V5KONSdInylhgSWkEXyoNm7uUe3r64xc Jun 16 18:35:11.596756 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Domain-Id: None Jun 16 18:35:11.596756 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Domain-Name: None Jun 16 18:35:11.596756 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Identity-Status: Confirmed Jun 16 18:35:11.596756 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Is-Admin-Project: True Jun 16 18:35:11.596756 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Project-Domain-Id: default Jun 16 18:35:11.596756 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Project-Domain-Name: Default Jun 16 18:35:11.596756 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Project-Id: 1f0473c6214a4428be438fabc530012b Jun 16 18:35:11.596756 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Project-Name: tempest-AttachVolumeNegativeTest-1927047282 Jun 16 18:35:11.596756 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Role: reader,member Jun 16 18:35:11.596756 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Roles: reader,member Jun 16 18:35:11.599459 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/1f0473c6214a4428be438fabc530012b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/1f0473c6214a4428be438fabc530012b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_1f0473c6214a4428be438fabc530012b", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/1f0473c6214a4428be438fabc530012b"}]}] Jun 16 18:35:11.599459 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Tenant: tempest-AttachVolumeNegativeTest-1927047282 Jun 16 18:35:11.599459 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Tenant-Id: 1f0473c6214a4428be438fabc530012b Jun 16 18:35:11.599459 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1927047282 Jun 16 18:35:11.599459 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-User: tempest-AttachVolumeNegativeTest-1927047282-project Jun 16 18:35:11.599459 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-User-Domain-Id: default Jun 16 18:35:11.599459 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-User-Domain-Name: Default Jun 16 18:35:11.599459 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-User-Id: 89f6c755dbf74640a372802f02733eb3 Jun 16 18:35:11.599459 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-User-Name: tempest-AttachVolumeNegativeTest-1927047282-project Jun 16 18:35:11.599459 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: method: > Jun 16 18:35:11.599459 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: exception: Instance e5de32bc-4cf2-47cd-b0de-bcc77b9a5791 could not be found. Jun 16 18:35:11.599459 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: action_args: {'id': 'e5de32bc-4cf2-47cd-b0de-bcc77b9a5791'} Jun 16 18:35:11.600876 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:35:11.600876 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:35:11.600876 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 18:35:11.600876 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 18:35:11.600876 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 18:35:11.600876 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 18:35:11.600876 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 18:35:11.600876 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 18:35:11.600876 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 18:35:11.600876 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 18:35:11.600876 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e5de32bc-4cf2-47cd-b0de-bcc77b9a5791 could not be found. Jun 16 18:35:11.600876 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Jun 16 18:35:11.600876 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:35:11.600876 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Jun 16 18:35:11.600876 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:35:11.600876 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:35:11.600876 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:35:11.600876 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:35:11.600876 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:35:11.600876 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:35:11.603467 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:35:11.603467 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 16 18:35:11.603467 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 16 18:35:11.603467 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 16 18:35:11.603467 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 16 18:35:11.603467 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 18:35:11.603467 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 18:35:11.603467 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 18:35:11.603467 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:35:11.603467 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e5de32bc-4cf2-47cd-b0de-bcc77b9a5791 could not be found. Jun 16 18:35:11.603467 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Jun 16 18:35:11.603467 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:35:11.603467 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Jun 16 18:35:11.603467 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:35:11.603467 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:35:11.603467 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:35:11.603467 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:35:11.603467 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:35:11.603467 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e5de32bc-4cf2-47cd-b0de-bcc77b9a5791 could not be found. Jun 16 18:35:11.603467 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Jun 16 18:35:11.606015 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-e8167264-0da9-46f4-87f9-186d2e32cd7d tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Returning 404 to user: Instance e5de32bc-4cf2-47cd-b0de-bcc77b9a5791 could not be found. {{(pid=117671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:35:11.606015 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-e8167264-0da9-46f4-87f9-186d2e32cd7d tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] 10.222.0.30 "DELETE /compute/v2.1/servers/e5de32bc-4cf2-47cd-b0de-bcc77b9a5791" status: 404 len: 111 microversion: 2.1 time: 0.039538 Jun 16 18:35:11.606015 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 338/708] 10.222.0.30 () {58 vars in 1238 bytes} [Thu Jun 16 18:35:11 2022] DELETE /compute/v2.1/servers/e5de32bc-4cf2-47cd-b0de-bcc77b9a5791 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 16 18:35:11.610554 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-3824d059-ae61-4b40-8055-8dec9fbd6419 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:35:11.611656 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-3824d059-ae61-4b40-8055-8dec9fbd6419 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] [instance: e5de32bc-4cf2-47cd-b0de-bcc77b9a5791] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:35:11.625206 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-3824d059-ae61-4b40-8055-8dec9fbd6419 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:35:11.625774 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-3824d059-ae61-4b40-8055-8dec9fbd6419 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:35:11.627106 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-3824d059-ae61-4b40-8055-8dec9fbd6419 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:35:11.627883 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-3824d059-ae61-4b40-8055-8dec9fbd6419 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:35:11.642981 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-b1a4fc67-f65e-4ae6-8e18-c9a779e517ea tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:35:11.652214 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.wsgi [None req-3824d059-ae61-4b40-8055-8dec9fbd6419 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] HTTP exception thrown: Instance e5de32bc-4cf2-47cd-b0de-bcc77b9a5791 could not be found. Jun 16 18:35:11.653865 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-b1a4fc67-f65e-4ae6-8e18-c9a779e517ea tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:35:11.654467 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-3824d059-ae61-4b40-8055-8dec9fbd6419 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Request method failure captured: Jun 16 18:35:11.654467 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: request: GET /compute/v2.1/servers/e5de32bc-4cf2-47cd-b0de-bcc77b9a5791 HTTP/1.1 Jun 16 18:35:11.654467 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: Accept: application/json Jun 16 18:35:11.654467 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: Accept-Encoding: identity Jun 16 18:35:11.654467 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: Connection: close Jun 16 18:35:11.654467 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: Content-Length: 0 Jun 16 18:35:11.654467 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: Content-Type: application/json Jun 16 18:35:11.654467 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: Host: 10.222.0.30 Jun 16 18:35:11.654467 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: Openstack-System-Scope: None Jun 16 18:35:11.654467 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: User-Agent: python-urllib3/1.26.9 Jun 16 18:35:11.654467 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Auth-Token: gAAAAABiq3ZX0T5cncUq62ubfwO6lq1Lv4hHDbhnjkkOIJCFH6tDdIm4lTs2-IIDJl9nzK-SwFmooLj6i7tKw5uiIiGwCsi7P_mYy-sE7ccdLwqhACdzBDGvbvHDziedNnH_4yw_ULKqsIs-KqEoe_8V5KONSdInylhgSWkEXyoNm7uUe3r64xc Jun 16 18:35:11.654467 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Domain-Id: None Jun 16 18:35:11.654467 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Domain-Name: None Jun 16 18:35:11.654467 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Identity-Status: Confirmed Jun 16 18:35:11.654467 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Is-Admin-Project: True Jun 16 18:35:11.654467 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Project-Domain-Id: default Jun 16 18:35:11.654467 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Project-Domain-Name: Default Jun 16 18:35:11.654467 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Project-Id: 1f0473c6214a4428be438fabc530012b Jun 16 18:35:11.654467 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Project-Name: tempest-AttachVolumeNegativeTest-1927047282 Jun 16 18:35:11.654467 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Role: reader,member Jun 16 18:35:11.654467 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Roles: reader,member Jun 16 18:35:11.657111 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/1f0473c6214a4428be438fabc530012b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/1f0473c6214a4428be438fabc530012b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_1f0473c6214a4428be438fabc530012b", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/1f0473c6214a4428be438fabc530012b"}]}] Jun 16 18:35:11.657111 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Tenant: tempest-AttachVolumeNegativeTest-1927047282 Jun 16 18:35:11.657111 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Tenant-Id: 1f0473c6214a4428be438fabc530012b Jun 16 18:35:11.657111 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1927047282 Jun 16 18:35:11.657111 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-User: tempest-AttachVolumeNegativeTest-1927047282-project Jun 16 18:35:11.657111 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-User-Domain-Id: default Jun 16 18:35:11.657111 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-User-Domain-Name: Default Jun 16 18:35:11.657111 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-User-Id: 89f6c755dbf74640a372802f02733eb3 Jun 16 18:35:11.657111 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-User-Name: tempest-AttachVolumeNegativeTest-1927047282-project Jun 16 18:35:11.657111 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: method: > Jun 16 18:35:11.657111 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: exception: Instance e5de32bc-4cf2-47cd-b0de-bcc77b9a5791 could not be found. Jun 16 18:35:11.657111 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: action_args: {'id': 'e5de32bc-4cf2-47cd-b0de-bcc77b9a5791'} Jun 16 18:35:11.658778 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:35:11.658778 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:35:11.658778 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 18:35:11.658778 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 18:35:11.658778 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 18:35:11.658778 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 18:35:11.658778 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 18:35:11.658778 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 18:35:11.658778 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 18:35:11.658778 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 18:35:11.658778 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e5de32bc-4cf2-47cd-b0de-bcc77b9a5791 could not be found. Jun 16 18:35:11.658778 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Jun 16 18:35:11.658778 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:35:11.658778 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Jun 16 18:35:11.658778 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:35:11.658778 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:35:11.658778 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:35:11.658778 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:35:11.658778 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:35:11.658778 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:35:11.662690 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:35:11.662690 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 18:35:11.662690 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 18:35:11.662690 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 18:35:11.662690 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 18:35:11.662690 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 18:35:11.662690 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:35:11.662690 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e5de32bc-4cf2-47cd-b0de-bcc77b9a5791 could not be found. Jun 16 18:35:11.662690 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Jun 16 18:35:11.662690 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:35:11.662690 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Jun 16 18:35:11.662690 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:35:11.662690 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:35:11.662690 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:35:11.662690 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:35:11.662690 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:35:11.662690 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e5de32bc-4cf2-47cd-b0de-bcc77b9a5791 could not be found. Jun 16 18:35:11.662690 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Jun 16 18:35:11.665766 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-3824d059-ae61-4b40-8055-8dec9fbd6419 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Returning 404 to user: Instance e5de32bc-4cf2-47cd-b0de-bcc77b9a5791 could not be found. {{(pid=117671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:35:11.665935 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-b1a4fc67-f65e-4ae6-8e18-c9a779e517ea tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:35:11.666142 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-3824d059-ae61-4b40-8055-8dec9fbd6419 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] 10.222.0.30 "GET /compute/v2.1/servers/e5de32bc-4cf2-47cd-b0de-bcc77b9a5791" status: 404 len: 111 microversion: 2.1 time: 0.050676 Jun 16 18:35:11.666321 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-b1a4fc67-f65e-4ae6-8e18-c9a779e517ea tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] 10.222.0.30 "GET /compute/v2.1/servers/16226ccb-8bc4-43b6-abd5-7601be0e57b5" status: 200 len: 1715 microversion: 2.20 time: 0.252667 Jun 16 18:35:11.666492 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 339/709] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:35:11 2022] GET /compute/v2.1/servers/e5de32bc-4cf2-47cd-b0de-bcc77b9a5791 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 16 18:35:11.671622 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-44cf6538-2b18-4771-9fcf-6bcf24660894 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:35:11.672923 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-44cf6538-2b18-4771-9fcf-6bcf24660894 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] [instance: e1382e00-fe71-4915-b4d8-0669cce4072d] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:35:11.673238 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 371/710] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Jun 16 18:35:11 2022] GET /compute/v2.1/servers/16226ccb-8bc4-43b6-abd5-7601be0e57b5 => generated 1715 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 18:35:11.684707 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-44cf6538-2b18-4771-9fcf-6bcf24660894 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:35:11.685276 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-44cf6538-2b18-4771-9fcf-6bcf24660894 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:35:11.686148 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-44cf6538-2b18-4771-9fcf-6bcf24660894 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:35:11.686683 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-44cf6538-2b18-4771-9fcf-6bcf24660894 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:35:11.706278 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.wsgi [None req-44cf6538-2b18-4771-9fcf-6bcf24660894 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] HTTP exception thrown: Instance e1382e00-fe71-4915-b4d8-0669cce4072d could not be found. Jun 16 18:35:11.708544 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-44cf6538-2b18-4771-9fcf-6bcf24660894 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Request method failure captured: Jun 16 18:35:11.708544 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: request: DELETE /compute/v2.1/servers/e1382e00-fe71-4915-b4d8-0669cce4072d HTTP/1.1 Jun 16 18:35:11.708544 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: Accept: application/json Jun 16 18:35:11.708544 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: Accept-Encoding: identity Jun 16 18:35:11.708544 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: Connection: close Jun 16 18:35:11.708544 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: Content-Length: 0 Jun 16 18:35:11.708544 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: Content-Type: application/json Jun 16 18:35:11.708544 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: Host: 10.222.0.30 Jun 16 18:35:11.708544 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: Openstack-System-Scope: None Jun 16 18:35:11.708544 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: User-Agent: python-urllib3/1.26.9 Jun 16 18:35:11.708544 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Auth-Token: gAAAAABiq3ZX0T5cncUq62ubfwO6lq1Lv4hHDbhnjkkOIJCFH6tDdIm4lTs2-IIDJl9nzK-SwFmooLj6i7tKw5uiIiGwCsi7P_mYy-sE7ccdLwqhACdzBDGvbvHDziedNnH_4yw_ULKqsIs-KqEoe_8V5KONSdInylhgSWkEXyoNm7uUe3r64xc Jun 16 18:35:11.708544 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Domain-Id: None Jun 16 18:35:11.708544 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Domain-Name: None Jun 16 18:35:11.708544 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Identity-Status: Confirmed Jun 16 18:35:11.708544 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Is-Admin-Project: True Jun 16 18:35:11.708544 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Project-Domain-Id: default Jun 16 18:35:11.708544 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Project-Domain-Name: Default Jun 16 18:35:11.708544 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Project-Id: 1f0473c6214a4428be438fabc530012b Jun 16 18:35:11.708544 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Project-Name: tempest-AttachVolumeNegativeTest-1927047282 Jun 16 18:35:11.708544 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Role: reader,member Jun 16 18:35:11.708544 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Roles: reader,member Jun 16 18:35:11.711247 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/1f0473c6214a4428be438fabc530012b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/1f0473c6214a4428be438fabc530012b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_1f0473c6214a4428be438fabc530012b", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/1f0473c6214a4428be438fabc530012b"}]}] Jun 16 18:35:11.711247 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Tenant: tempest-AttachVolumeNegativeTest-1927047282 Jun 16 18:35:11.711247 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Tenant-Id: 1f0473c6214a4428be438fabc530012b Jun 16 18:35:11.711247 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1927047282 Jun 16 18:35:11.711247 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-User: tempest-AttachVolumeNegativeTest-1927047282-project Jun 16 18:35:11.711247 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-User-Domain-Id: default Jun 16 18:35:11.711247 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-User-Domain-Name: Default Jun 16 18:35:11.711247 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-User-Id: 89f6c755dbf74640a372802f02733eb3 Jun 16 18:35:11.711247 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-User-Name: tempest-AttachVolumeNegativeTest-1927047282-project Jun 16 18:35:11.711247 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: method: > Jun 16 18:35:11.711247 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: exception: Instance e1382e00-fe71-4915-b4d8-0669cce4072d could not be found. Jun 16 18:35:11.711247 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: action_args: {'id': 'e1382e00-fe71-4915-b4d8-0669cce4072d'} Jun 16 18:35:11.712975 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:35:11.712975 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:35:11.712975 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 18:35:11.712975 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 18:35:11.712975 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 18:35:11.712975 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 18:35:11.712975 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 18:35:11.712975 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 18:35:11.712975 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 18:35:11.712975 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 18:35:11.712975 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e1382e00-fe71-4915-b4d8-0669cce4072d could not be found. Jun 16 18:35:11.712975 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Jun 16 18:35:11.712975 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:35:11.712975 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Jun 16 18:35:11.712975 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:35:11.712975 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:35:11.712975 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:35:11.712975 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:35:11.712975 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:35:11.712975 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:35:11.716202 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:35:11.716202 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 16 18:35:11.716202 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 16 18:35:11.716202 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 16 18:35:11.716202 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 16 18:35:11.716202 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 18:35:11.716202 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 18:35:11.716202 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 18:35:11.716202 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:35:11.716202 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e1382e00-fe71-4915-b4d8-0669cce4072d could not be found. Jun 16 18:35:11.716202 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Jun 16 18:35:11.716202 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:35:11.716202 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Jun 16 18:35:11.716202 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:35:11.716202 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:35:11.716202 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:35:11.716202 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:35:11.716202 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:35:11.716202 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e1382e00-fe71-4915-b4d8-0669cce4072d could not be found. Jun 16 18:35:11.716202 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Jun 16 18:35:11.718638 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-44cf6538-2b18-4771-9fcf-6bcf24660894 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Returning 404 to user: Instance e1382e00-fe71-4915-b4d8-0669cce4072d could not be found. {{(pid=117671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:35:11.718638 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-44cf6538-2b18-4771-9fcf-6bcf24660894 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] 10.222.0.30 "DELETE /compute/v2.1/servers/e1382e00-fe71-4915-b4d8-0669cce4072d" status: 404 len: 111 microversion: 2.1 time: 0.044036 Jun 16 18:35:11.718638 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 340/711] 10.222.0.30 () {58 vars in 1238 bytes} [Thu Jun 16 18:35:11 2022] DELETE /compute/v2.1/servers/e1382e00-fe71-4915-b4d8-0669cce4072d => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:35:11.724754 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-84e1a1f6-c76c-464b-b3e1-f13dc92a4e59 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:35:11.725880 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-84e1a1f6-c76c-464b-b3e1-f13dc92a4e59 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] [instance: e1382e00-fe71-4915-b4d8-0669cce4072d] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:35:11.737407 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-84e1a1f6-c76c-464b-b3e1-f13dc92a4e59 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:35:11.738185 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-84e1a1f6-c76c-464b-b3e1-f13dc92a4e59 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:35:11.740554 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-84e1a1f6-c76c-464b-b3e1-f13dc92a4e59 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:35:11.741142 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-84e1a1f6-c76c-464b-b3e1-f13dc92a4e59 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:35:11.760634 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.wsgi [None req-84e1a1f6-c76c-464b-b3e1-f13dc92a4e59 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] HTTP exception thrown: Instance e1382e00-fe71-4915-b4d8-0669cce4072d could not be found. Jun 16 18:35:11.762681 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-84e1a1f6-c76c-464b-b3e1-f13dc92a4e59 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Request method failure captured: Jun 16 18:35:11.762681 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: request: GET /compute/v2.1/servers/e1382e00-fe71-4915-b4d8-0669cce4072d HTTP/1.1 Jun 16 18:35:11.762681 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: Accept: application/json Jun 16 18:35:11.762681 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: Accept-Encoding: identity Jun 16 18:35:11.762681 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: Connection: close Jun 16 18:35:11.762681 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: Content-Length: 0 Jun 16 18:35:11.762681 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: Content-Type: application/json Jun 16 18:35:11.762681 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: Host: 10.222.0.30 Jun 16 18:35:11.762681 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: Openstack-System-Scope: None Jun 16 18:35:11.762681 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: User-Agent: python-urllib3/1.26.9 Jun 16 18:35:11.762681 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Auth-Token: gAAAAABiq3ZX0T5cncUq62ubfwO6lq1Lv4hHDbhnjkkOIJCFH6tDdIm4lTs2-IIDJl9nzK-SwFmooLj6i7tKw5uiIiGwCsi7P_mYy-sE7ccdLwqhACdzBDGvbvHDziedNnH_4yw_ULKqsIs-KqEoe_8V5KONSdInylhgSWkEXyoNm7uUe3r64xc Jun 16 18:35:11.762681 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Domain-Id: None Jun 16 18:35:11.762681 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Domain-Name: None Jun 16 18:35:11.762681 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Identity-Status: Confirmed Jun 16 18:35:11.762681 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Is-Admin-Project: True Jun 16 18:35:11.762681 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Project-Domain-Id: default Jun 16 18:35:11.762681 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Project-Domain-Name: Default Jun 16 18:35:11.762681 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Project-Id: 1f0473c6214a4428be438fabc530012b Jun 16 18:35:11.762681 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Project-Name: tempest-AttachVolumeNegativeTest-1927047282 Jun 16 18:35:11.762681 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Role: reader,member Jun 16 18:35:11.762681 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Roles: reader,member Jun 16 18:35:11.765494 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/1f0473c6214a4428be438fabc530012b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/1f0473c6214a4428be438fabc530012b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_1f0473c6214a4428be438fabc530012b", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/1f0473c6214a4428be438fabc530012b"}]}] Jun 16 18:35:11.765494 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Tenant: tempest-AttachVolumeNegativeTest-1927047282 Jun 16 18:35:11.765494 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Tenant-Id: 1f0473c6214a4428be438fabc530012b Jun 16 18:35:11.765494 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1927047282 Jun 16 18:35:11.765494 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-User: tempest-AttachVolumeNegativeTest-1927047282-project Jun 16 18:35:11.765494 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-User-Domain-Id: default Jun 16 18:35:11.765494 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-User-Domain-Name: Default Jun 16 18:35:11.765494 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-User-Id: 89f6c755dbf74640a372802f02733eb3 Jun 16 18:35:11.765494 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-User-Name: tempest-AttachVolumeNegativeTest-1927047282-project Jun 16 18:35:11.765494 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: method: > Jun 16 18:35:11.765494 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: exception: Instance e1382e00-fe71-4915-b4d8-0669cce4072d could not be found. Jun 16 18:35:11.765494 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: action_args: {'id': 'e1382e00-fe71-4915-b4d8-0669cce4072d'} Jun 16 18:35:11.766836 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:35:11.766836 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:35:11.766836 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 18:35:11.766836 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 18:35:11.766836 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 18:35:11.766836 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 18:35:11.766836 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 18:35:11.766836 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 18:35:11.766836 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 18:35:11.766836 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 18:35:11.766836 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e1382e00-fe71-4915-b4d8-0669cce4072d could not be found. Jun 16 18:35:11.766836 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi Jun 16 18:35:11.766836 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:35:11.766836 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi Jun 16 18:35:11.766836 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:35:11.766836 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:35:11.766836 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:35:11.766836 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:35:11.766836 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:35:11.766836 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:35:11.768957 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:35:11.768957 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 18:35:11.768957 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 18:35:11.768957 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 18:35:11.768957 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 18:35:11.768957 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 18:35:11.768957 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:35:11.768957 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e1382e00-fe71-4915-b4d8-0669cce4072d could not be found. Jun 16 18:35:11.768957 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi Jun 16 18:35:11.768957 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:35:11.768957 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi Jun 16 18:35:11.768957 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:35:11.768957 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:35:11.768957 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:35:11.768957 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:35:11.768957 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:35:11.768957 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e1382e00-fe71-4915-b4d8-0669cce4072d could not be found. Jun 16 18:35:11.768957 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi Jun 16 18:35:11.770526 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-84e1a1f6-c76c-464b-b3e1-f13dc92a4e59 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Returning 404 to user: Instance e1382e00-fe71-4915-b4d8-0669cce4072d could not be found. {{(pid=117670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:35:11.770526 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-84e1a1f6-c76c-464b-b3e1-f13dc92a4e59 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] 10.222.0.30 "GET /compute/v2.1/servers/e1382e00-fe71-4915-b4d8-0669cce4072d" status: 404 len: 111 microversion: 2.1 time: 0.047188 Jun 16 18:35:11.770526 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 372/712] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:35:11 2022] GET /compute/v2.1/servers/e1382e00-fe71-4915-b4d8-0669cce4072d => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:35:12.127523 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-a63ac051-0165-4338-a423-267bd66f1228 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:35:12.128373 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-a63ac051-0165-4338-a423-267bd66f1228 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] [instance: f116c8d4-a63e-47e1-bb50-ec64f735bfcc] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:35:12.137710 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-a63ac051-0165-4338-a423-267bd66f1228 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:35:12.138293 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-a63ac051-0165-4338-a423-267bd66f1228 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:35:12.139133 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-a63ac051-0165-4338-a423-267bd66f1228 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:35:12.139572 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-a63ac051-0165-4338-a423-267bd66f1228 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:35:12.305346 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-a63ac051-0165-4338-a423-267bd66f1228 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebdf8e3cd1b44dcba37cdcfb4af7db2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a8e1d26bdfc400ebd1e070b09db615e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:35:12.318622 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-a63ac051-0165-4338-a423-267bd66f1228 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] 10.222.0.30 "GET /compute/v2.1/servers/f116c8d4-a63e-47e1-bb50-ec64f735bfcc" status: 200 len: 1363 microversion: 2.1 time: 0.195472 Jun 16 18:35:12.319735 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 341/713] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:35:12 2022] GET /compute/v2.1/servers/f116c8d4-a63e-47e1-bb50-ec64f735bfcc => generated 1363 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:35:12.924761 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-e2204cfb-049b-4d50-bdc1-7564c0e12a59 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:35:12.925585 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-e2204cfb-049b-4d50-bdc1-7564c0e12a59 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] [instance: 121f052a-2d96-444d-a817-38e348aaf0e5] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:35:12.933005 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-e2204cfb-049b-4d50-bdc1-7564c0e12a59 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:35:12.933454 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-e2204cfb-049b-4d50-bdc1-7564c0e12a59 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:35:12.934965 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-e2204cfb-049b-4d50-bdc1-7564c0e12a59 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:35:12.934965 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-e2204cfb-049b-4d50-bdc1-7564c0e12a59 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:35:12.952373 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.wsgi [None req-e2204cfb-049b-4d50-bdc1-7564c0e12a59 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] HTTP exception thrown: Instance 121f052a-2d96-444d-a817-38e348aaf0e5 could not be found. Jun 16 18:35:12.954012 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-e2204cfb-049b-4d50-bdc1-7564c0e12a59 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Request method failure captured: Jun 16 18:35:12.954012 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: request: DELETE /compute/v2.1/servers/121f052a-2d96-444d-a817-38e348aaf0e5 HTTP/1.1 Jun 16 18:35:12.954012 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: Accept: application/json Jun 16 18:35:12.954012 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: Accept-Encoding: identity Jun 16 18:35:12.954012 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: Connection: close Jun 16 18:35:12.954012 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: Content-Length: 0 Jun 16 18:35:12.954012 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: Content-Type: application/json Jun 16 18:35:12.954012 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: Host: 10.222.0.30 Jun 16 18:35:12.954012 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: Openstack-System-Scope: None Jun 16 18:35:12.954012 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: User-Agent: python-urllib3/1.26.9 Jun 16 18:35:12.954012 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Auth-Token: gAAAAABiq3ZX0T5cncUq62ubfwO6lq1Lv4hHDbhnjkkOIJCFH6tDdIm4lTs2-IIDJl9nzK-SwFmooLj6i7tKw5uiIiGwCsi7P_mYy-sE7ccdLwqhACdzBDGvbvHDziedNnH_4yw_ULKqsIs-KqEoe_8V5KONSdInylhgSWkEXyoNm7uUe3r64xc Jun 16 18:35:12.954012 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Domain-Id: None Jun 16 18:35:12.954012 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Domain-Name: None Jun 16 18:35:12.954012 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Identity-Status: Confirmed Jun 16 18:35:12.954012 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Is-Admin-Project: True Jun 16 18:35:12.954012 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Project-Domain-Id: default Jun 16 18:35:12.954012 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Project-Domain-Name: Default Jun 16 18:35:12.954012 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Project-Id: 1f0473c6214a4428be438fabc530012b Jun 16 18:35:12.954012 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Project-Name: tempest-AttachVolumeNegativeTest-1927047282 Jun 16 18:35:12.954012 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Role: reader,member Jun 16 18:35:12.954012 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Roles: reader,member Jun 16 18:35:12.956151 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/1f0473c6214a4428be438fabc530012b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/1f0473c6214a4428be438fabc530012b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_1f0473c6214a4428be438fabc530012b", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/1f0473c6214a4428be438fabc530012b"}]}] Jun 16 18:35:12.956151 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Tenant: tempest-AttachVolumeNegativeTest-1927047282 Jun 16 18:35:12.956151 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Tenant-Id: 1f0473c6214a4428be438fabc530012b Jun 16 18:35:12.956151 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1927047282 Jun 16 18:35:12.956151 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-User: tempest-AttachVolumeNegativeTest-1927047282-project Jun 16 18:35:12.956151 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-User-Domain-Id: default Jun 16 18:35:12.956151 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-User-Domain-Name: Default Jun 16 18:35:12.956151 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-User-Id: 89f6c755dbf74640a372802f02733eb3 Jun 16 18:35:12.956151 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-User-Name: tempest-AttachVolumeNegativeTest-1927047282-project Jun 16 18:35:12.956151 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: method: > Jun 16 18:35:12.956151 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: exception: Instance 121f052a-2d96-444d-a817-38e348aaf0e5 could not be found. Jun 16 18:35:12.956151 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: action_args: {'id': '121f052a-2d96-444d-a817-38e348aaf0e5'} Jun 16 18:35:12.957362 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:35:12.957362 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:35:12.957362 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 18:35:12.957362 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 18:35:12.957362 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 18:35:12.957362 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 18:35:12.957362 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 18:35:12.957362 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 18:35:12.957362 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 18:35:12.957362 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 18:35:12.957362 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 121f052a-2d96-444d-a817-38e348aaf0e5 could not be found. Jun 16 18:35:12.957362 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi Jun 16 18:35:12.957362 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:35:12.957362 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi Jun 16 18:35:12.957362 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:35:12.957362 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:35:12.957362 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:35:12.957362 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:35:12.957362 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:35:12.957362 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:35:12.960698 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:35:12.960698 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 16 18:35:12.960698 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 16 18:35:12.960698 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 16 18:35:12.960698 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 16 18:35:12.960698 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 18:35:12.960698 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 18:35:12.960698 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 18:35:12.960698 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:35:12.960698 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 121f052a-2d96-444d-a817-38e348aaf0e5 could not be found. Jun 16 18:35:12.960698 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi Jun 16 18:35:12.960698 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:35:12.960698 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi Jun 16 18:35:12.960698 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:35:12.960698 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:35:12.960698 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:35:12.960698 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:35:12.960698 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:35:12.960698 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 121f052a-2d96-444d-a817-38e348aaf0e5 could not be found. Jun 16 18:35:12.960698 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi Jun 16 18:35:12.963237 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-e2204cfb-049b-4d50-bdc1-7564c0e12a59 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Returning 404 to user: Instance 121f052a-2d96-444d-a817-38e348aaf0e5 could not be found. {{(pid=117670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:35:12.963237 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-e2204cfb-049b-4d50-bdc1-7564c0e12a59 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] 10.222.0.30 "DELETE /compute/v2.1/servers/121f052a-2d96-444d-a817-38e348aaf0e5" status: 404 len: 111 microversion: 2.1 time: 0.035235 Jun 16 18:35:12.963237 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 373/714] 10.222.0.30 () {58 vars in 1238 bytes} [Thu Jun 16 18:35:12 2022] DELETE /compute/v2.1/servers/121f052a-2d96-444d-a817-38e348aaf0e5 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 16 18:35:12.970539 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-43a34d4a-8257-4bfd-863f-bcd565722ec1 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:35:12.971661 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-43a34d4a-8257-4bfd-863f-bcd565722ec1 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] [instance: 121f052a-2d96-444d-a817-38e348aaf0e5] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:35:12.983483 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-43a34d4a-8257-4bfd-863f-bcd565722ec1 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:35:12.984289 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-43a34d4a-8257-4bfd-863f-bcd565722ec1 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:35:12.985622 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-43a34d4a-8257-4bfd-863f-bcd565722ec1 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:35:12.986444 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-43a34d4a-8257-4bfd-863f-bcd565722ec1 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:35:13.013430 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.wsgi [None req-43a34d4a-8257-4bfd-863f-bcd565722ec1 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] HTTP exception thrown: Instance 121f052a-2d96-444d-a817-38e348aaf0e5 could not be found. Jun 16 18:35:13.016496 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-43a34d4a-8257-4bfd-863f-bcd565722ec1 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Request method failure captured: Jun 16 18:35:13.016496 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: request: GET /compute/v2.1/servers/121f052a-2d96-444d-a817-38e348aaf0e5 HTTP/1.1 Jun 16 18:35:13.016496 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: Accept: application/json Jun 16 18:35:13.016496 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: Accept-Encoding: identity Jun 16 18:35:13.016496 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: Connection: close Jun 16 18:35:13.016496 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: Content-Length: 0 Jun 16 18:35:13.016496 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: Content-Type: application/json Jun 16 18:35:13.016496 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: Host: 10.222.0.30 Jun 16 18:35:13.016496 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: Openstack-System-Scope: None Jun 16 18:35:13.016496 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: User-Agent: python-urllib3/1.26.9 Jun 16 18:35:13.016496 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Auth-Token: gAAAAABiq3ZX0T5cncUq62ubfwO6lq1Lv4hHDbhnjkkOIJCFH6tDdIm4lTs2-IIDJl9nzK-SwFmooLj6i7tKw5uiIiGwCsi7P_mYy-sE7ccdLwqhACdzBDGvbvHDziedNnH_4yw_ULKqsIs-KqEoe_8V5KONSdInylhgSWkEXyoNm7uUe3r64xc Jun 16 18:35:13.016496 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Domain-Id: None Jun 16 18:35:13.016496 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Domain-Name: None Jun 16 18:35:13.016496 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Identity-Status: Confirmed Jun 16 18:35:13.016496 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Is-Admin-Project: True Jun 16 18:35:13.016496 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Project-Domain-Id: default Jun 16 18:35:13.016496 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Project-Domain-Name: Default Jun 16 18:35:13.016496 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Project-Id: 1f0473c6214a4428be438fabc530012b Jun 16 18:35:13.016496 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Project-Name: tempest-AttachVolumeNegativeTest-1927047282 Jun 16 18:35:13.016496 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Role: reader,member Jun 16 18:35:13.016496 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Roles: reader,member Jun 16 18:35:13.018121 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/1f0473c6214a4428be438fabc530012b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/1f0473c6214a4428be438fabc530012b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_1f0473c6214a4428be438fabc530012b", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/1f0473c6214a4428be438fabc530012b"}]}] Jun 16 18:35:13.018121 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Tenant: tempest-AttachVolumeNegativeTest-1927047282 Jun 16 18:35:13.018121 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Tenant-Id: 1f0473c6214a4428be438fabc530012b Jun 16 18:35:13.018121 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1927047282 Jun 16 18:35:13.018121 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-User: tempest-AttachVolumeNegativeTest-1927047282-project Jun 16 18:35:13.018121 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-User-Domain-Id: default Jun 16 18:35:13.018121 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-User-Domain-Name: Default Jun 16 18:35:13.018121 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-User-Id: 89f6c755dbf74640a372802f02733eb3 Jun 16 18:35:13.018121 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-User-Name: tempest-AttachVolumeNegativeTest-1927047282-project Jun 16 18:35:13.018121 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: method: > Jun 16 18:35:13.018121 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: exception: Instance 121f052a-2d96-444d-a817-38e348aaf0e5 could not be found. Jun 16 18:35:13.018121 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: action_args: {'id': '121f052a-2d96-444d-a817-38e348aaf0e5'} Jun 16 18:35:13.018981 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:35:13.018981 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:35:13.018981 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 18:35:13.018981 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 18:35:13.018981 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 18:35:13.018981 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 18:35:13.018981 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 18:35:13.018981 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 18:35:13.018981 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 18:35:13.018981 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 18:35:13.018981 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 121f052a-2d96-444d-a817-38e348aaf0e5 could not be found. Jun 16 18:35:13.018981 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Jun 16 18:35:13.018981 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:35:13.018981 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Jun 16 18:35:13.018981 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:35:13.018981 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:35:13.018981 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:35:13.018981 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:35:13.018981 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:35:13.018981 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:35:13.020908 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:35:13.020908 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 18:35:13.020908 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 18:35:13.020908 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 18:35:13.020908 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 18:35:13.020908 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 18:35:13.020908 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:35:13.020908 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 121f052a-2d96-444d-a817-38e348aaf0e5 could not be found. Jun 16 18:35:13.020908 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Jun 16 18:35:13.020908 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:35:13.020908 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Jun 16 18:35:13.020908 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:35:13.020908 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:35:13.020908 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:35:13.020908 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:35:13.020908 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:35:13.020908 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 121f052a-2d96-444d-a817-38e348aaf0e5 could not be found. Jun 16 18:35:13.020908 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Jun 16 18:35:13.022059 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-43a34d4a-8257-4bfd-863f-bcd565722ec1 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] Returning 404 to user: Instance 121f052a-2d96-444d-a817-38e348aaf0e5 could not be found. {{(pid=117671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:35:13.022059 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-43a34d4a-8257-4bfd-863f-bcd565722ec1 tempest-AttachVolumeNegativeTest-1927047282 tempest-AttachVolumeNegativeTest-1927047282-project] 10.222.0.30 "GET /compute/v2.1/servers/121f052a-2d96-444d-a817-38e348aaf0e5" status: 404 len: 111 microversion: 2.1 time: 0.056577 Jun 16 18:35:13.022059 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 342/715] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:35:12 2022] GET /compute/v2.1/servers/121f052a-2d96-444d-a817-38e348aaf0e5 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:35:13.340023 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-5dd811b7-9b79-449e-9ef8-f02f59316722 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:35:13.341269 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-5dd811b7-9b79-449e-9ef8-f02f59316722 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] [instance: f116c8d4-a63e-47e1-bb50-ec64f735bfcc] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:35:13.349231 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-5dd811b7-9b79-449e-9ef8-f02f59316722 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:35:13.350048 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-5dd811b7-9b79-449e-9ef8-f02f59316722 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:35:13.351146 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-5dd811b7-9b79-449e-9ef8-f02f59316722 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:35:13.351738 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-5dd811b7-9b79-449e-9ef8-f02f59316722 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:35:13.577124 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-5dd811b7-9b79-449e-9ef8-f02f59316722 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebdf8e3cd1b44dcba37cdcfb4af7db2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a8e1d26bdfc400ebd1e070b09db615e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:35:13.591877 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-5dd811b7-9b79-449e-9ef8-f02f59316722 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] 10.222.0.30 "GET /compute/v2.1/servers/f116c8d4-a63e-47e1-bb50-ec64f735bfcc" status: 200 len: 1548 microversion: 2.1 time: 0.257782 Jun 16 18:35:13.600115 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 374/716] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:35:13 2022] GET /compute/v2.1/servers/f116c8d4-a63e-47e1-bb50-ec64f735bfcc => generated 1548 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:35:13.614963 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-24a649fd-d698-4e27-9e79-21ea1633f851 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:35:13.615904 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-24a649fd-d698-4e27-9e79-21ea1633f851 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] [instance: f116c8d4-a63e-47e1-bb50-ec64f735bfcc] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:35:13.624807 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-24a649fd-d698-4e27-9e79-21ea1633f851 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:35:13.625324 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-24a649fd-d698-4e27-9e79-21ea1633f851 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:35:13.626513 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-24a649fd-d698-4e27-9e79-21ea1633f851 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:35:13.627043 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-24a649fd-d698-4e27-9e79-21ea1633f851 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:35:13.757607 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-24a649fd-d698-4e27-9e79-21ea1633f851 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] 10.222.0.30 "GET /compute/v2.1/servers/f116c8d4-a63e-47e1-bb50-ec64f735bfcc/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.147989 Jun 16 18:35:13.758717 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 343/717] 10.222.0.30 () {58 vars in 1274 bytes} [Thu Jun 16 18:35:13 2022] GET /compute/v2.1/servers/f116c8d4-a63e-47e1-bb50-ec64f735bfcc/os-interface => generated 284 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 18:35:16.516987 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [req-44b3d4b0-b7e2-4277-8b86-39886a70bbcb req-79091855-be5b-4b0a-948b-f3d856ac507c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f116c8d4-a63e-47e1-bb50-ec64f735bfcc", "tag": "897c17d5-5664-4330-a940-38c13c304dca"}]} {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:35:16.533817 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [req-44b3d4b0-b7e2-4277-8b86-39886a70bbcb req-79091855-be5b-4b0a-948b-f3d856ac507c service nova] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:35:16.534551 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [req-44b3d4b0-b7e2-4277-8b86-39886a70bbcb req-79091855-be5b-4b0a-948b-f3d856ac507c service nova] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:35:16.553533 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.compute.server_external_events [req-44b3d4b0-b7e2-4277-8b86-39886a70bbcb req-79091855-be5b-4b0a-948b-f3d856ac507c service nova] Creating event network-changed:897c17d5-5664-4330-a940-38c13c304dca for instance f116c8d4-a63e-47e1-bb50-ec64f735bfcc on hv-cinder-81322 Jun 16 18:35:16.561700 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [req-44b3d4b0-b7e2-4277-8b86-39886a70bbcb req-79091855-be5b-4b0a-948b-f3d856ac507c service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054951 Jun 16 18:35:16.563191 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 375/718] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Jun 16 18:35:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:35:21.432717 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-5496d44d-b967-429a-8c58-645be050094b tempest-VolumesSnapshotsTestJSON-1892634822 tempest-VolumesSnapshotsTestJSON-1892634822-project] Action: 'create', calling method: .version_select at 0x7fbb23c82040>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1463860657"}} {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:35:21.882291 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-5496d44d-b967-429a-8c58-645be050094b tempest-VolumesSnapshotsTestJSON-1892634822 tempest-VolumesSnapshotsTestJSON-1892634822-project] 10.222.0.30 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.629532 Jun 16 18:35:21.883090 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 344/719] 10.222.0.30 () {60 vars in 1154 bytes} [Thu Jun 16 18:35:21 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 632 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jun 16 18:35:21.899397 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-16d97160-6541-487a-98af-91a793518eae tempest-VolumesSnapshotsTestJSON-1892634822 tempest-VolumesSnapshotsTestJSON-1892634822-project] Calling method '.version_select at 0x7fbb23e64ca0>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:35:21.990446 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-16d97160-6541-487a-98af-91a793518eae tempest-VolumesSnapshotsTestJSON-1892634822 tempest-VolumesSnapshotsTestJSON-1892634822-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/0a4c7a06-ec52-444b-86cf-65f272145cda" status: 200 len: 345 microversion: 2.1 time: 0.094382 Jun 16 18:35:21.990818 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 376/720] 10.222.0.30 () {58 vars in 1244 bytes} [Thu Jun 16 18:35:21 2022] GET /compute/v2.1/os-volumes/0a4c7a06-ec52-444b-86cf-65f272145cda => generated 345 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 18:35:23.008695 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-7be6bd4f-c11c-4616-bb48-64c35afa4563 tempest-VolumesSnapshotsTestJSON-1892634822 tempest-VolumesSnapshotsTestJSON-1892634822-project] Calling method '.version_select at 0x7fbb23c83ca0>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:35:23.100420 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-7be6bd4f-c11c-4616-bb48-64c35afa4563 tempest-VolumesSnapshotsTestJSON-1892634822 tempest-VolumesSnapshotsTestJSON-1892634822-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/0a4c7a06-ec52-444b-86cf-65f272145cda" status: 200 len: 346 microversion: 2.1 time: 0.099720 Jun 16 18:35:23.101165 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 345/721] 10.222.0.30 () {58 vars in 1244 bytes} [Thu Jun 16 18:35:22 2022] GET /compute/v2.1/os-volumes/0a4c7a06-ec52-444b-86cf-65f272145cda => generated 346 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:35:23.113720 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-e66cf1fe-2333-4694-ba5e-da21dcaf05ff tempest-VolumesSnapshotsTestJSON-1892634822 tempest-VolumesSnapshotsTestJSON-1892634822-project] Action: 'create', calling method: .version_select at 0x7fbb346d2430>, body: {"snapshot": {"volume_id": "0a4c7a06-ec52-444b-86cf-65f272145cda", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1792441297"}} {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:35:23.326922 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-e66cf1fe-2333-4694-ba5e-da21dcaf05ff tempest-VolumesSnapshotsTestJSON-1892634822 tempest-VolumesSnapshotsTestJSON-1892634822-project] 10.222.0.30 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.217199 Jun 16 18:35:23.327977 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 377/722] 10.222.0.30 () {60 vars in 1161 bytes} [Thu Jun 16 18:35:23 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 18:35:23.340407 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-1f434940-811d-4012-9d9c-94c61dcd689b tempest-VolumesSnapshotsTestJSON-1892634822 tempest-VolumesSnapshotsTestJSON-1892634822-project] Calling method '.version_select at 0x7fbb23ca7820>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:35:23.389928 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-1f434940-811d-4012-9d9c-94c61dcd689b tempest-VolumesSnapshotsTestJSON-1892634822 tempest-VolumesSnapshotsTestJSON-1892634822-project] 10.222.0.30 "GET /compute/v2.1/os-snapshots/7083e408-d1a4-48ed-a83a-06926204d07a" status: 200 len: 287 microversion: 2.1 time: 0.054294 Jun 16 18:35:23.390980 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 346/723] 10.222.0.30 () {58 vars in 1250 bytes} [Thu Jun 16 18:35:23 2022] GET /compute/v2.1/os-snapshots/7083e408-d1a4-48ed-a83a-06926204d07a => generated 287 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:35:23.405469 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-cf5af015-b4d3-46de-b71e-cdb53a814822 tempest-VolumesSnapshotsTestJSON-1892634822 tempest-VolumesSnapshotsTestJSON-1892634822-project] Calling method '.version_select at 0x7fbb34740b80>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:35:23.440671 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-cf5af015-b4d3-46de-b71e-cdb53a814822 tempest-VolumesSnapshotsTestJSON-1892634822 tempest-VolumesSnapshotsTestJSON-1892634822-project] 10.222.0.30 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.039539 Jun 16 18:35:23.441423 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 378/724] 10.222.0.30 () {58 vars in 1139 bytes} [Thu Jun 16 18:35:23 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:35:23.459486 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-a4289e4c-7203-4dea-b764-bd8cfb4fdb8b tempest-VolumesSnapshotsTestJSON-1892634822 tempest-VolumesSnapshotsTestJSON-1892634822-project] Calling method '.version_select at 0x7fbb23c51a60>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:35:23.500106 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-a4289e4c-7203-4dea-b764-bd8cfb4fdb8b tempest-VolumesSnapshotsTestJSON-1892634822 tempest-VolumesSnapshotsTestJSON-1892634822-project] 10.222.0.30 "GET /compute/v2.1/os-snapshots/7083e408-d1a4-48ed-a83a-06926204d07a" status: 200 len: 287 microversion: 2.1 time: 0.048309 Jun 16 18:35:23.500785 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 347/725] 10.222.0.30 () {58 vars in 1250 bytes} [Thu Jun 16 18:35:23 2022] GET /compute/v2.1/os-snapshots/7083e408-d1a4-48ed-a83a-06926204d07a => generated 287 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:35:24.516645 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-31d2f992-a7a5-4c18-82e7-3d79ced69c77 tempest-VolumesSnapshotsTestJSON-1892634822 tempest-VolumesSnapshotsTestJSON-1892634822-project] Calling method '.version_select at 0x7fbb3470d310>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:35:24.555849 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-31d2f992-a7a5-4c18-82e7-3d79ced69c77 tempest-VolumesSnapshotsTestJSON-1892634822 tempest-VolumesSnapshotsTestJSON-1892634822-project] 10.222.0.30 "GET /compute/v2.1/os-snapshots/7083e408-d1a4-48ed-a83a-06926204d07a" status: 200 len: 287 microversion: 2.1 time: 0.044089 Jun 16 18:35:24.556505 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 379/726] 10.222.0.30 () {58 vars in 1250 bytes} [Thu Jun 16 18:35:24 2022] GET /compute/v2.1/os-snapshots/7083e408-d1a4-48ed-a83a-06926204d07a => generated 287 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:35:25.571621 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-b3bb2f2a-f668-4754-8b8d-cb92877ed6a8 tempest-VolumesSnapshotsTestJSON-1892634822 tempest-VolumesSnapshotsTestJSON-1892634822-project] Calling method '.version_select at 0x7fbb23ca75e0>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:35:25.578587 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG dbcounter [-] [117671] Writing DB stats nova_api:SELECT=37 {{(pid=117671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:35:25.579795 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG dbcounter [-] [117671] Writing DB stats nova_cell1:SELECT=51 {{(pid=117671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:35:25.609458 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-b3bb2f2a-f668-4754-8b8d-cb92877ed6a8 tempest-VolumesSnapshotsTestJSON-1892634822 tempest-VolumesSnapshotsTestJSON-1892634822-project] 10.222.0.30 "GET /compute/v2.1/os-snapshots/7083e408-d1a4-48ed-a83a-06926204d07a" status: 200 len: 287 microversion: 2.1 time: 0.045021 Jun 16 18:35:25.610259 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 348/727] 10.222.0.30 () {58 vars in 1250 bytes} [Thu Jun 16 18:35:25 2022] GET /compute/v2.1/os-snapshots/7083e408-d1a4-48ed-a83a-06926204d07a => generated 287 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:35:26.619998 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG dbcounter [-] [117670] Writing DB stats nova_api:SELECT=20,nova_api:DELETE=1 {{(pid=117670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:35:26.620831 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG dbcounter [-] [117670] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:35:26.625489 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-243da72a-4d9c-4ebb-b88f-125e437adaa5 tempest-VolumesSnapshotsTestJSON-1892634822 tempest-VolumesSnapshotsTestJSON-1892634822-project] Calling method '.version_select at 0x7fbb3471aa60>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:35:26.665337 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-243da72a-4d9c-4ebb-b88f-125e437adaa5 tempest-VolumesSnapshotsTestJSON-1892634822 tempest-VolumesSnapshotsTestJSON-1892634822-project] 10.222.0.30 "GET /compute/v2.1/os-snapshots/7083e408-d1a4-48ed-a83a-06926204d07a" status: 200 len: 288 microversion: 2.1 time: 0.046443 Jun 16 18:35:26.666066 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 380/728] 10.222.0.30 () {58 vars in 1250 bytes} [Thu Jun 16 18:35:26 2022] GET /compute/v2.1/os-snapshots/7083e408-d1a4-48ed-a83a-06926204d07a => generated 288 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:35:26.679177 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-9e1ce46c-7227-4461-86b5-b8914fe92ca9 tempest-VolumesSnapshotsTestJSON-1892634822 tempest-VolumesSnapshotsTestJSON-1892634822-project] Calling method '.version_select at 0x7fbb23c828b0>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:35:26.755512 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-9e1ce46c-7227-4461-86b5-b8914fe92ca9 tempest-VolumesSnapshotsTestJSON-1892634822 tempest-VolumesSnapshotsTestJSON-1892634822-project] 10.222.0.30 "DELETE /compute/v2.1/os-snapshots/7083e408-d1a4-48ed-a83a-06926204d07a" status: 202 len: 0 microversion: 2.1 time: 0.081312 Jun 16 18:35:26.756394 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 349/729] 10.222.0.30 () {58 vars in 1253 bytes} [Thu Jun 16 18:35:26 2022] DELETE /compute/v2.1/os-snapshots/7083e408-d1a4-48ed-a83a-06926204d07a => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 16 18:35:26.766819 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-1c674bc5-b728-4445-8090-14e903016019 tempest-VolumesSnapshotsTestJSON-1892634822 tempest-VolumesSnapshotsTestJSON-1892634822-project] Calling method '.version_select at 0x7fbb3021aaf0>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:35:26.801129 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-1c674bc5-b728-4445-8090-14e903016019 tempest-VolumesSnapshotsTestJSON-1892634822 tempest-VolumesSnapshotsTestJSON-1892634822-project] 10.222.0.30 "GET /compute/v2.1/os-snapshots/7083e408-d1a4-48ed-a83a-06926204d07a" status: 200 len: 287 microversion: 2.1 time: 0.038735 Jun 16 18:35:26.802692 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 381/730] 10.222.0.30 () {58 vars in 1250 bytes} [Thu Jun 16 18:35:26 2022] GET /compute/v2.1/os-snapshots/7083e408-d1a4-48ed-a83a-06926204d07a => generated 287 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:35:27.815514 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-59792301-1aca-44c9-abca-192a586f47c7 tempest-VolumesSnapshotsTestJSON-1892634822 tempest-VolumesSnapshotsTestJSON-1892634822-project] Calling method '.version_select at 0x7fbb23cc4b80>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:35:27.854194 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.wsgi [None req-59792301-1aca-44c9-abca-192a586f47c7 tempest-VolumesSnapshotsTestJSON-1892634822 tempest-VolumesSnapshotsTestJSON-1892634822-project] HTTP exception thrown: Snapshot 7083e408-d1a4-48ed-a83a-06926204d07a could not be found. Jun 16 18:35:27.856592 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-59792301-1aca-44c9-abca-192a586f47c7 tempest-VolumesSnapshotsTestJSON-1892634822 tempest-VolumesSnapshotsTestJSON-1892634822-project] Request method failure captured: Jun 16 18:35:27.856592 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: request: GET /compute/v2.1/os-snapshots/7083e408-d1a4-48ed-a83a-06926204d07a HTTP/1.1 Jun 16 18:35:27.856592 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: Accept: application/json Jun 16 18:35:27.856592 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: Accept-Encoding: identity Jun 16 18:35:27.856592 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: Connection: close Jun 16 18:35:27.856592 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: Content-Length: 0 Jun 16 18:35:27.856592 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: Content-Type: application/json Jun 16 18:35:27.856592 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: Host: 10.222.0.30 Jun 16 18:35:27.856592 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: Openstack-System-Scope: None Jun 16 18:35:27.856592 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: User-Agent: python-urllib3/1.26.9 Jun 16 18:35:27.856592 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Auth-Token: gAAAAABiq3fpRvsbyCGeNCiicWS0Zw9CzaQJYPlRZJbbp7L0VsAgfB4Hr5DHo4_Yl2k4efnqWIOEP7GW9TcKQjTd87edmLaUi6uXF6iDp06X0nlU_qg-F0GFSr6NblI9TB-MHHBQUiBGbplPbniGtAJh4I8p3DhOSXIDpC46H3wQVKi8FEf2bcg Jun 16 18:35:27.856592 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Domain-Id: None Jun 16 18:35:27.856592 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Domain-Name: None Jun 16 18:35:27.856592 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Identity-Status: Confirmed Jun 16 18:35:27.856592 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Is-Admin-Project: True Jun 16 18:35:27.856592 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Project-Domain-Id: default Jun 16 18:35:27.856592 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Project-Domain-Name: Default Jun 16 18:35:27.856592 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Project-Id: 9912e6b0e37344ff9c319165892bd814 Jun 16 18:35:27.856592 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1892634822 Jun 16 18:35:27.856592 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Role: reader,member Jun 16 18:35:27.856592 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Roles: reader,member Jun 16 18:35:27.859272 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/9912e6b0e37344ff9c319165892bd814"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/9912e6b0e37344ff9c319165892bd814"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_9912e6b0e37344ff9c319165892bd814", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/9912e6b0e37344ff9c319165892bd814"}]}] Jun 16 18:35:27.859272 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1892634822 Jun 16 18:35:27.859272 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Tenant-Id: 9912e6b0e37344ff9c319165892bd814 Jun 16 18:35:27.859272 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1892634822 Jun 16 18:35:27.859272 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-User: tempest-VolumesSnapshotsTestJSON-1892634822-project Jun 16 18:35:27.859272 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-User-Domain-Id: default Jun 16 18:35:27.859272 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-User-Domain-Name: Default Jun 16 18:35:27.859272 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-User-Id: de673266a65c478c8700a46d6e842413 Jun 16 18:35:27.859272 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1892634822-project Jun 16 18:35:27.859272 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: method: Jun 16 18:35:27.859272 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: exception: Snapshot 7083e408-d1a4-48ed-a83a-06926204d07a could not be found. Jun 16 18:35:27.859272 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: action_args: {'id': '7083e408-d1a4-48ed-a83a-06926204d07a'} Jun 16 18:35:27.859272 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:35:27.860894 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:35:27.860894 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jun 16 18:35:27.860894 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 16 18:35:27.860894 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jun 16 18:35:27.860894 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jun 16 18:35:27.860894 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jun 16 18:35:27.860894 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jun 16 18:35:27.860894 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 16 18:35:27.860894 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 16 18:35:27.860894 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 16 18:35:27.860894 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 16 18:35:27.860894 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 18:35:27.860894 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 18:35:27.860894 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 18:35:27.860894 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 18:35:27.860894 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 7083e408-d1a4-48ed-a83a-06926204d07a could not be found. (HTTP 404) (Request-ID: req-0fffb442-b1f0-44a0-9855-e0e588bf4b9c) Jun 16 18:35:27.860894 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Jun 16 18:35:27.860894 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:35:27.862960 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Jun 16 18:35:27.862960 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:35:27.862960 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jun 16 18:35:27.862960 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jun 16 18:35:27.862960 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 16 18:35:27.862960 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 16 18:35:27.862960 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jun 16 18:35:27.862960 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jun 16 18:35:27.862960 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 16 18:35:27.862960 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 16 18:35:27.862960 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jun 16 18:35:27.862960 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 16 18:35:27.862960 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jun 16 18:35:27.862960 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jun 16 18:35:27.862960 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jun 16 18:35:27.862960 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jun 16 18:35:27.862960 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 16 18:35:27.862960 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 16 18:35:27.862960 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 16 18:35:27.867209 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 16 18:35:27.867209 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 18:35:27.867209 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 18:35:27.867209 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 18:35:27.867209 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 18:35:27.867209 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 7083e408-d1a4-48ed-a83a-06926204d07a could not be found. Jun 16 18:35:27.867209 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Jun 16 18:35:27.867209 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:35:27.867209 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Jun 16 18:35:27.867209 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:35:27.867209 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:35:27.867209 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:35:27.867209 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:35:27.867209 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:35:27.867209 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 18:35:27.867209 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 18:35:27.867209 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:35:27.867209 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:35:27.867209 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jun 16 18:35:27.867209 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:35:27.869471 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 7083e408-d1a4-48ed-a83a-06926204d07a could not be found. Jun 16 18:35:27.869471 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Jun 16 18:35:27.869471 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:35:27.869471 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Jun 16 18:35:27.869471 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:35:27.869471 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:35:27.869471 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:35:27.869471 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:35:27.869471 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:35:27.869471 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 7083e408-d1a4-48ed-a83a-06926204d07a could not be found. Jun 16 18:35:27.869471 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Jun 16 18:35:27.869471 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-59792301-1aca-44c9-abca-192a586f47c7 tempest-VolumesSnapshotsTestJSON-1892634822 tempest-VolumesSnapshotsTestJSON-1892634822-project] Returning 404 to user: Snapshot 7083e408-d1a4-48ed-a83a-06926204d07a could not be found. {{(pid=117671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:35:27.869471 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-59792301-1aca-44c9-abca-192a586f47c7 tempest-VolumesSnapshotsTestJSON-1892634822 tempest-VolumesSnapshotsTestJSON-1892634822-project] 10.222.0.30 "GET /compute/v2.1/os-snapshots/7083e408-d1a4-48ed-a83a-06926204d07a" status: 404 len: 111 microversion: 2.1 time: 0.047243 Jun 16 18:35:27.870853 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 350/731] 10.222.0.30 () {58 vars in 1250 bytes} [Thu Jun 16 18:35:27 2022] GET /compute/v2.1/os-snapshots/7083e408-d1a4-48ed-a83a-06926204d07a => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:35:27.870988 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-4c4b7809-8d22-45d5-9327-6172639abebb tempest-VolumesSnapshotsTestJSON-1892634822 tempest-VolumesSnapshotsTestJSON-1892634822-project] Calling method '.version_select at 0x7fbb23dced30>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:35:27.944673 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-4c4b7809-8d22-45d5-9327-6172639abebb tempest-VolumesSnapshotsTestJSON-1892634822 tempest-VolumesSnapshotsTestJSON-1892634822-project] 10.222.0.30 "DELETE /compute/v2.1/os-volumes/0a4c7a06-ec52-444b-86cf-65f272145cda" status: 202 len: 0 microversion: 2.1 time: 0.080616 Jun 16 18:35:27.945326 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 382/732] 10.222.0.30 () {58 vars in 1247 bytes} [Thu Jun 16 18:35:27 2022] DELETE /compute/v2.1/os-volumes/0a4c7a06-ec52-444b-86cf-65f272145cda => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 16 18:35:27.955930 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-7bddbac0-6a1f-4bbc-bf28-33d7304717da tempest-VolumesSnapshotsTestJSON-1892634822 tempest-VolumesSnapshotsTestJSON-1892634822-project] Calling method '.version_select at 0x7fbb23c828b0>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:35:28.017670 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-7bddbac0-6a1f-4bbc-bf28-33d7304717da tempest-VolumesSnapshotsTestJSON-1892634822 tempest-VolumesSnapshotsTestJSON-1892634822-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/0a4c7a06-ec52-444b-86cf-65f272145cda" status: 200 len: 345 microversion: 2.1 time: 0.067327 Jun 16 18:35:28.018324 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 351/733] 10.222.0.30 () {58 vars in 1244 bytes} [Thu Jun 16 18:35:27 2022] GET /compute/v2.1/os-volumes/0a4c7a06-ec52-444b-86cf-65f272145cda => generated 345 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:35:29.040658 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-ab98bbce-132e-4456-bab4-1b7b7bb5517b tempest-VolumesSnapshotsTestJSON-1892634822 tempest-VolumesSnapshotsTestJSON-1892634822-project] Calling method '.version_select at 0x7fbb346f5700>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:35:29.074284 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.wsgi [None req-ab98bbce-132e-4456-bab4-1b7b7bb5517b tempest-VolumesSnapshotsTestJSON-1892634822 tempest-VolumesSnapshotsTestJSON-1892634822-project] HTTP exception thrown: Volume 0a4c7a06-ec52-444b-86cf-65f272145cda could not be found. Jun 16 18:35:29.077919 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-ab98bbce-132e-4456-bab4-1b7b7bb5517b tempest-VolumesSnapshotsTestJSON-1892634822 tempest-VolumesSnapshotsTestJSON-1892634822-project] Request method failure captured: Jun 16 18:35:29.077919 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: request: GET /compute/v2.1/os-volumes/0a4c7a06-ec52-444b-86cf-65f272145cda HTTP/1.1 Jun 16 18:35:29.077919 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: Accept: application/json Jun 16 18:35:29.077919 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: Accept-Encoding: identity Jun 16 18:35:29.077919 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: Connection: close Jun 16 18:35:29.077919 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: Content-Length: 0 Jun 16 18:35:29.077919 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: Content-Type: application/json Jun 16 18:35:29.077919 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: Host: 10.222.0.30 Jun 16 18:35:29.077919 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: Openstack-System-Scope: None Jun 16 18:35:29.077919 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: User-Agent: python-urllib3/1.26.9 Jun 16 18:35:29.077919 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Auth-Token: gAAAAABiq3fpRvsbyCGeNCiicWS0Zw9CzaQJYPlRZJbbp7L0VsAgfB4Hr5DHo4_Yl2k4efnqWIOEP7GW9TcKQjTd87edmLaUi6uXF6iDp06X0nlU_qg-F0GFSr6NblI9TB-MHHBQUiBGbplPbniGtAJh4I8p3DhOSXIDpC46H3wQVKi8FEf2bcg Jun 16 18:35:29.077919 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Domain-Id: None Jun 16 18:35:29.077919 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Domain-Name: None Jun 16 18:35:29.077919 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Identity-Status: Confirmed Jun 16 18:35:29.077919 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Is-Admin-Project: True Jun 16 18:35:29.077919 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Project-Domain-Id: default Jun 16 18:35:29.077919 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Project-Domain-Name: Default Jun 16 18:35:29.077919 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Project-Id: 9912e6b0e37344ff9c319165892bd814 Jun 16 18:35:29.077919 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1892634822 Jun 16 18:35:29.077919 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Role: reader,member Jun 16 18:35:29.077919 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Roles: reader,member Jun 16 18:35:29.079533 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/9912e6b0e37344ff9c319165892bd814"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/9912e6b0e37344ff9c319165892bd814"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_9912e6b0e37344ff9c319165892bd814", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/9912e6b0e37344ff9c319165892bd814"}]}] Jun 16 18:35:29.079533 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1892634822 Jun 16 18:35:29.079533 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Tenant-Id: 9912e6b0e37344ff9c319165892bd814 Jun 16 18:35:29.079533 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1892634822 Jun 16 18:35:29.079533 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-User: tempest-VolumesSnapshotsTestJSON-1892634822-project Jun 16 18:35:29.079533 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-User-Domain-Id: default Jun 16 18:35:29.079533 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-User-Domain-Name: Default Jun 16 18:35:29.079533 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-User-Id: de673266a65c478c8700a46d6e842413 Jun 16 18:35:29.079533 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1892634822-project Jun 16 18:35:29.079533 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: method: Jun 16 18:35:29.079533 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: exception: Volume 0a4c7a06-ec52-444b-86cf-65f272145cda could not be found. Jun 16 18:35:29.079533 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: action_args: {'id': '0a4c7a06-ec52-444b-86cf-65f272145cda'} Jun 16 18:35:29.079533 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:35:29.080568 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:35:29.080568 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 16 18:35:29.080568 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 16 18:35:29.080568 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 16 18:35:29.080568 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 16 18:35:29.080568 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 16 18:35:29.080568 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 16 18:35:29.080568 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 16 18:35:29.080568 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 16 18:35:29.080568 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 16 18:35:29.080568 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 16 18:35:29.080568 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 18:35:29.080568 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 18:35:29.080568 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 18:35:29.080568 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 18:35:29.080568 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 0a4c7a06-ec52-444b-86cf-65f272145cda could not be found. (HTTP 404) (Request-ID: req-0899d65b-9479-4429-bf98-7baa26134633) Jun 16 18:35:29.080568 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi Jun 16 18:35:29.080568 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:35:29.080568 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi Jun 16 18:35:29.081918 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:35:29.081918 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 16 18:35:29.081918 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 16 18:35:29.081918 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 16 18:35:29.081918 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 16 18:35:29.081918 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 16 18:35:29.081918 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 16 18:35:29.081918 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 16 18:35:29.081918 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 16 18:35:29.081918 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 16 18:35:29.081918 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 16 18:35:29.081918 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 16 18:35:29.081918 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 16 18:35:29.081918 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 16 18:35:29.081918 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 16 18:35:29.081918 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 16 18:35:29.081918 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 16 18:35:29.081918 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 16 18:35:29.081918 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 16 18:35:29.084323 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 18:35:29.084323 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 18:35:29.084323 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 18:35:29.084323 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 18:35:29.084323 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 0a4c7a06-ec52-444b-86cf-65f272145cda could not be found. Jun 16 18:35:29.084323 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi Jun 16 18:35:29.084323 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:35:29.084323 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi Jun 16 18:35:29.084323 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:35:29.084323 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:35:29.084323 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:35:29.084323 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:35:29.084323 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:35:29.084323 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 18:35:29.084323 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 18:35:29.084323 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:35:29.084323 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:35:29.084323 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 16 18:35:29.084323 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:35:29.085806 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 0a4c7a06-ec52-444b-86cf-65f272145cda could not be found. Jun 16 18:35:29.085806 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi Jun 16 18:35:29.085806 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:35:29.085806 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi Jun 16 18:35:29.085806 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:35:29.085806 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:35:29.085806 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:35:29.085806 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:35:29.085806 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:35:29.085806 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 0a4c7a06-ec52-444b-86cf-65f272145cda could not be found. Jun 16 18:35:29.085806 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi Jun 16 18:35:29.085806 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-ab98bbce-132e-4456-bab4-1b7b7bb5517b tempest-VolumesSnapshotsTestJSON-1892634822 tempest-VolumesSnapshotsTestJSON-1892634822-project] Returning 404 to user: Volume 0a4c7a06-ec52-444b-86cf-65f272145cda could not be found. {{(pid=117670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:35:29.085806 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-ab98bbce-132e-4456-bab4-1b7b7bb5517b tempest-VolumesSnapshotsTestJSON-1892634822 tempest-VolumesSnapshotsTestJSON-1892634822-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/0a4c7a06-ec52-444b-86cf-65f272145cda" status: 404 len: 109 microversion: 2.1 time: 0.051050 Jun 16 18:35:29.085806 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 383/734] 10.222.0.30 () {58 vars in 1244 bytes} [Thu Jun 16 18:35:29 2022] GET /compute/v2.1/os-volumes/0a4c7a06-ec52-444b-86cf-65f272145cda => generated 109 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:35:29.096703 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-cd56c8f7-2ee5-4503-8a46-b8a7778d5745 tempest-VolumesSnapshotsTestJSON-1892634822 tempest-VolumesSnapshotsTestJSON-1892634822-project] Calling method '.version_select at 0x7fbb23ca73a0>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:35:29.132829 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.wsgi [None req-cd56c8f7-2ee5-4503-8a46-b8a7778d5745 tempest-VolumesSnapshotsTestJSON-1892634822 tempest-VolumesSnapshotsTestJSON-1892634822-project] HTTP exception thrown: Volume 0a4c7a06-ec52-444b-86cf-65f272145cda could not be found. Jun 16 18:35:29.134807 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-cd56c8f7-2ee5-4503-8a46-b8a7778d5745 tempest-VolumesSnapshotsTestJSON-1892634822 tempest-VolumesSnapshotsTestJSON-1892634822-project] Request method failure captured: Jun 16 18:35:29.134807 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: request: DELETE /compute/v2.1/os-volumes/0a4c7a06-ec52-444b-86cf-65f272145cda HTTP/1.1 Jun 16 18:35:29.134807 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: Accept: application/json Jun 16 18:35:29.134807 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: Accept-Encoding: identity Jun 16 18:35:29.134807 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: Connection: close Jun 16 18:35:29.134807 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: Content-Length: 0 Jun 16 18:35:29.134807 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: Content-Type: application/json Jun 16 18:35:29.134807 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: Host: 10.222.0.30 Jun 16 18:35:29.134807 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: Openstack-System-Scope: None Jun 16 18:35:29.134807 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: User-Agent: python-urllib3/1.26.9 Jun 16 18:35:29.134807 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Auth-Token: gAAAAABiq3fpRvsbyCGeNCiicWS0Zw9CzaQJYPlRZJbbp7L0VsAgfB4Hr5DHo4_Yl2k4efnqWIOEP7GW9TcKQjTd87edmLaUi6uXF6iDp06X0nlU_qg-F0GFSr6NblI9TB-MHHBQUiBGbplPbniGtAJh4I8p3DhOSXIDpC46H3wQVKi8FEf2bcg Jun 16 18:35:29.134807 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Domain-Id: None Jun 16 18:35:29.134807 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Domain-Name: None Jun 16 18:35:29.134807 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Identity-Status: Confirmed Jun 16 18:35:29.134807 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Is-Admin-Project: True Jun 16 18:35:29.134807 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Project-Domain-Id: default Jun 16 18:35:29.134807 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Project-Domain-Name: Default Jun 16 18:35:29.134807 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Project-Id: 9912e6b0e37344ff9c319165892bd814 Jun 16 18:35:29.134807 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1892634822 Jun 16 18:35:29.134807 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Role: reader,member Jun 16 18:35:29.134807 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Roles: reader,member Jun 16 18:35:29.137413 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/9912e6b0e37344ff9c319165892bd814"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/9912e6b0e37344ff9c319165892bd814"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_9912e6b0e37344ff9c319165892bd814", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/9912e6b0e37344ff9c319165892bd814"}]}] Jun 16 18:35:29.137413 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1892634822 Jun 16 18:35:29.137413 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Tenant-Id: 9912e6b0e37344ff9c319165892bd814 Jun 16 18:35:29.137413 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1892634822 Jun 16 18:35:29.137413 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-User: tempest-VolumesSnapshotsTestJSON-1892634822-project Jun 16 18:35:29.137413 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-User-Domain-Id: default Jun 16 18:35:29.137413 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-User-Domain-Name: Default Jun 16 18:35:29.137413 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-User-Id: de673266a65c478c8700a46d6e842413 Jun 16 18:35:29.137413 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1892634822-project Jun 16 18:35:29.137413 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: method: Jun 16 18:35:29.137413 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: exception: Volume 0a4c7a06-ec52-444b-86cf-65f272145cda could not be found. Jun 16 18:35:29.137413 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: action_args: {'id': '0a4c7a06-ec52-444b-86cf-65f272145cda'} Jun 16 18:35:29.137413 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:35:29.138790 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:35:29.138790 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 16 18:35:29.138790 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 16 18:35:29.138790 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 16 18:35:29.138790 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 16 18:35:29.138790 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 16 18:35:29.138790 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 16 18:35:29.138790 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 16 18:35:29.138790 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 16 18:35:29.138790 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 16 18:35:29.138790 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 16 18:35:29.138790 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 18:35:29.138790 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 18:35:29.138790 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 18:35:29.138790 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 18:35:29.138790 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 0a4c7a06-ec52-444b-86cf-65f272145cda could not be found. (HTTP 404) (Request-ID: req-1ef60f6a-e9a3-4879-b411-51f8d04c3167) Jun 16 18:35:29.138790 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Jun 16 18:35:29.138790 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:35:29.138790 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Jun 16 18:35:29.140874 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:35:29.140874 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 16 18:35:29.140874 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 16 18:35:29.140874 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 16 18:35:29.140874 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 16 18:35:29.140874 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 16 18:35:29.140874 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 16 18:35:29.140874 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 16 18:35:29.140874 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 16 18:35:29.140874 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 16 18:35:29.140874 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 16 18:35:29.140874 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 16 18:35:29.140874 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 16 18:35:29.140874 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 16 18:35:29.140874 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 16 18:35:29.140874 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 16 18:35:29.140874 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 16 18:35:29.140874 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 16 18:35:29.140874 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 16 18:35:29.143001 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 18:35:29.143001 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 18:35:29.143001 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 18:35:29.143001 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 18:35:29.143001 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 0a4c7a06-ec52-444b-86cf-65f272145cda could not be found. Jun 16 18:35:29.143001 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Jun 16 18:35:29.143001 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:35:29.143001 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Jun 16 18:35:29.143001 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:35:29.143001 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:35:29.143001 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:35:29.143001 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:35:29.143001 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:35:29.143001 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 18:35:29.143001 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 18:35:29.143001 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:35:29.143001 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:35:29.143001 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 16 18:35:29.143001 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:35:29.145194 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 0a4c7a06-ec52-444b-86cf-65f272145cda could not be found. Jun 16 18:35:29.145194 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Jun 16 18:35:29.145194 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:35:29.145194 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Jun 16 18:35:29.145194 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:35:29.145194 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:35:29.145194 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:35:29.145194 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:35:29.145194 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:35:29.145194 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 0a4c7a06-ec52-444b-86cf-65f272145cda could not be found. Jun 16 18:35:29.145194 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Jun 16 18:35:29.145194 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-cd56c8f7-2ee5-4503-8a46-b8a7778d5745 tempest-VolumesSnapshotsTestJSON-1892634822 tempest-VolumesSnapshotsTestJSON-1892634822-project] Returning 404 to user: Volume 0a4c7a06-ec52-444b-86cf-65f272145cda could not be found. {{(pid=117671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:35:29.145194 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-cd56c8f7-2ee5-4503-8a46-b8a7778d5745 tempest-VolumesSnapshotsTestJSON-1892634822 tempest-VolumesSnapshotsTestJSON-1892634822-project] 10.222.0.30 "DELETE /compute/v2.1/os-volumes/0a4c7a06-ec52-444b-86cf-65f272145cda" status: 404 len: 109 microversion: 2.1 time: 0.044426 Jun 16 18:35:29.145194 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 352/735] 10.222.0.30 () {58 vars in 1247 bytes} [Thu Jun 16 18:35:29 2022] DELETE /compute/v2.1/os-volumes/0a4c7a06-ec52-444b-86cf-65f272145cda => generated 109 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:35:29.147812 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-8c79b903-b9e6-4674-af6f-f5a621da6b2a tempest-VolumesSnapshotsTestJSON-1892634822 tempest-VolumesSnapshotsTestJSON-1892634822-project] Calling method '.version_select at 0x7fbb23dce310>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:35:29.184366 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.wsgi [None req-8c79b903-b9e6-4674-af6f-f5a621da6b2a tempest-VolumesSnapshotsTestJSON-1892634822 tempest-VolumesSnapshotsTestJSON-1892634822-project] HTTP exception thrown: Volume 0a4c7a06-ec52-444b-86cf-65f272145cda could not be found. Jun 16 18:35:29.186896 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-8c79b903-b9e6-4674-af6f-f5a621da6b2a tempest-VolumesSnapshotsTestJSON-1892634822 tempest-VolumesSnapshotsTestJSON-1892634822-project] Request method failure captured: Jun 16 18:35:29.186896 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: request: GET /compute/v2.1/os-volumes/0a4c7a06-ec52-444b-86cf-65f272145cda HTTP/1.1 Jun 16 18:35:29.186896 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: Accept: application/json Jun 16 18:35:29.186896 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: Accept-Encoding: identity Jun 16 18:35:29.186896 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: Connection: close Jun 16 18:35:29.186896 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: Content-Length: 0 Jun 16 18:35:29.186896 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: Content-Type: application/json Jun 16 18:35:29.186896 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: Host: 10.222.0.30 Jun 16 18:35:29.186896 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: Openstack-System-Scope: None Jun 16 18:35:29.186896 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: User-Agent: python-urllib3/1.26.9 Jun 16 18:35:29.186896 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Auth-Token: gAAAAABiq3fpRvsbyCGeNCiicWS0Zw9CzaQJYPlRZJbbp7L0VsAgfB4Hr5DHo4_Yl2k4efnqWIOEP7GW9TcKQjTd87edmLaUi6uXF6iDp06X0nlU_qg-F0GFSr6NblI9TB-MHHBQUiBGbplPbniGtAJh4I8p3DhOSXIDpC46H3wQVKi8FEf2bcg Jun 16 18:35:29.186896 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Domain-Id: None Jun 16 18:35:29.186896 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Domain-Name: None Jun 16 18:35:29.186896 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Identity-Status: Confirmed Jun 16 18:35:29.186896 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Is-Admin-Project: True Jun 16 18:35:29.186896 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Project-Domain-Id: default Jun 16 18:35:29.186896 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Project-Domain-Name: Default Jun 16 18:35:29.186896 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Project-Id: 9912e6b0e37344ff9c319165892bd814 Jun 16 18:35:29.186896 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1892634822 Jun 16 18:35:29.186896 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Role: reader,member Jun 16 18:35:29.186896 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Roles: reader,member Jun 16 18:35:29.189321 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/9912e6b0e37344ff9c319165892bd814"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/9912e6b0e37344ff9c319165892bd814"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_9912e6b0e37344ff9c319165892bd814", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/9912e6b0e37344ff9c319165892bd814"}]}] Jun 16 18:35:29.189321 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1892634822 Jun 16 18:35:29.189321 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Tenant-Id: 9912e6b0e37344ff9c319165892bd814 Jun 16 18:35:29.189321 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1892634822 Jun 16 18:35:29.189321 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-User: tempest-VolumesSnapshotsTestJSON-1892634822-project Jun 16 18:35:29.189321 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-User-Domain-Id: default Jun 16 18:35:29.189321 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-User-Domain-Name: Default Jun 16 18:35:29.189321 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-User-Id: de673266a65c478c8700a46d6e842413 Jun 16 18:35:29.189321 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1892634822-project Jun 16 18:35:29.189321 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: method: Jun 16 18:35:29.189321 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: exception: Volume 0a4c7a06-ec52-444b-86cf-65f272145cda could not be found. Jun 16 18:35:29.189321 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: action_args: {'id': '0a4c7a06-ec52-444b-86cf-65f272145cda'} Jun 16 18:35:29.189321 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:35:29.190977 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:35:29.190977 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 16 18:35:29.190977 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 16 18:35:29.190977 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 16 18:35:29.190977 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 16 18:35:29.190977 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 16 18:35:29.190977 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 16 18:35:29.190977 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 16 18:35:29.190977 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 16 18:35:29.190977 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 16 18:35:29.190977 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 16 18:35:29.190977 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 18:35:29.190977 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 18:35:29.190977 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 18:35:29.190977 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 18:35:29.190977 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 0a4c7a06-ec52-444b-86cf-65f272145cda could not be found. (HTTP 404) (Request-ID: req-65af2756-563c-4c49-a762-c0f08a26d49d) Jun 16 18:35:29.190977 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi Jun 16 18:35:29.190977 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:35:29.190977 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi Jun 16 18:35:29.194920 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:35:29.194920 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 16 18:35:29.194920 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 16 18:35:29.194920 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 16 18:35:29.194920 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 16 18:35:29.194920 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 16 18:35:29.194920 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 16 18:35:29.194920 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 16 18:35:29.194920 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 16 18:35:29.194920 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 16 18:35:29.194920 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 16 18:35:29.194920 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 16 18:35:29.194920 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 16 18:35:29.194920 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 16 18:35:29.194920 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 16 18:35:29.194920 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 16 18:35:29.194920 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 16 18:35:29.194920 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 16 18:35:29.194920 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 16 18:35:29.197293 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 18:35:29.197293 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 18:35:29.197293 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 18:35:29.197293 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 18:35:29.197293 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 0a4c7a06-ec52-444b-86cf-65f272145cda could not be found. Jun 16 18:35:29.197293 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi Jun 16 18:35:29.197293 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:35:29.197293 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi Jun 16 18:35:29.197293 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:35:29.197293 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:35:29.197293 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:35:29.197293 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:35:29.197293 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:35:29.197293 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 18:35:29.197293 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 18:35:29.197293 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:35:29.197293 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:35:29.197293 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 16 18:35:29.197293 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:35:29.199883 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 0a4c7a06-ec52-444b-86cf-65f272145cda could not be found. Jun 16 18:35:29.199883 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi Jun 16 18:35:29.199883 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:35:29.199883 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi Jun 16 18:35:29.199883 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:35:29.199883 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:35:29.199883 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:35:29.199883 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:35:29.199883 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:35:29.199883 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 0a4c7a06-ec52-444b-86cf-65f272145cda could not be found. Jun 16 18:35:29.199883 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi Jun 16 18:35:29.199883 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-8c79b903-b9e6-4674-af6f-f5a621da6b2a tempest-VolumesSnapshotsTestJSON-1892634822 tempest-VolumesSnapshotsTestJSON-1892634822-project] Returning 404 to user: Volume 0a4c7a06-ec52-444b-86cf-65f272145cda could not be found. {{(pid=117670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:35:29.199883 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-8c79b903-b9e6-4674-af6f-f5a621da6b2a tempest-VolumesSnapshotsTestJSON-1892634822 tempest-VolumesSnapshotsTestJSON-1892634822-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/0a4c7a06-ec52-444b-86cf-65f272145cda" status: 404 len: 109 microversion: 2.1 time: 0.046901 Jun 16 18:35:29.199883 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 384/736] 10.222.0.30 () {58 vars in 1244 bytes} [Thu Jun 16 18:35:29 2022] GET /compute/v2.1/os-volumes/0a4c7a06-ec52-444b-86cf-65f272145cda => generated 109 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 16 18:35:49.916421 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-efdf4f82-0f2d-4560-82ab-150faec4c426 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:35:49.918981 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-efdf4f82-0f2d-4560-82ab-150faec4c426 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] [instance: 16226ccb-8bc4-43b6-abd5-7601be0e57b5] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:35:49.932569 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-efdf4f82-0f2d-4560-82ab-150faec4c426 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:35:49.933242 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-efdf4f82-0f2d-4560-82ab-150faec4c426 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:35:49.936036 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-efdf4f82-0f2d-4560-82ab-150faec4c426 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:35:49.936036 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-efdf4f82-0f2d-4560-82ab-150faec4c426 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:35:49.993931 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-efdf4f82-0f2d-4560-82ab-150faec4c426 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] 10.222.0.30 "GET /compute/v2.1/servers/16226ccb-8bc4-43b6-abd5-7601be0e57b5/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.089039 Jun 16 18:35:49.994739 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 353/737] 10.222.0.30 () {60 vars in 1342 bytes} [Thu Jun 16 18:35:49 2022] GET /compute/v2.1/servers/16226ccb-8bc4-43b6-abd5-7601be0e57b5/os-volume_attachments => generated 25 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:35:50.106761 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-276f8edb-094a-4a78-9386-d57f5624bad4 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:35:50.107839 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-276f8edb-094a-4a78-9386-d57f5624bad4 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] [instance: 16226ccb-8bc4-43b6-abd5-7601be0e57b5] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:35:50.119697 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-276f8edb-094a-4a78-9386-d57f5624bad4 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:35:50.120521 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-276f8edb-094a-4a78-9386-d57f5624bad4 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:35:50.122277 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-276f8edb-094a-4a78-9386-d57f5624bad4 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:35:50.122688 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-276f8edb-094a-4a78-9386-d57f5624bad4 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:35:50.175390 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-276f8edb-094a-4a78-9386-d57f5624bad4 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] [instance: 16226ccb-8bc4-43b6-abd5-7601be0e57b5] Going to try to terminate instance {{(pid=117670) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 18:35:50.307852 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-276f8edb-094a-4a78-9386-d57f5624bad4 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] 10.222.0.30 "DELETE /compute/v2.1/servers/16226ccb-8bc4-43b6-abd5-7601be0e57b5" status: 204 len: 0 microversion: 2.20 time: 0.210787 Jun 16 18:35:50.308617 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 385/738] 10.222.0.30 () {60 vars in 1279 bytes} [Thu Jun 16 18:35:50 2022] DELETE /compute/v2.1/servers/16226ccb-8bc4-43b6-abd5-7601be0e57b5 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 16 18:35:50.327903 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-50b3a77a-bd74-4e57-aace-338a28ef830f tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:35:50.329616 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-50b3a77a-bd74-4e57-aace-338a28ef830f tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] [instance: 16226ccb-8bc4-43b6-abd5-7601be0e57b5] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:35:50.339537 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-50b3a77a-bd74-4e57-aace-338a28ef830f tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:35:50.340322 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-50b3a77a-bd74-4e57-aace-338a28ef830f tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:35:50.341028 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-50b3a77a-bd74-4e57-aace-338a28ef830f tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:35:50.341628 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-50b3a77a-bd74-4e57-aace-338a28ef830f tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:35:50.549923 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-50b3a77a-bd74-4e57-aace-338a28ef830f tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:35:50.562791 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-50b3a77a-bd74-4e57-aace-338a28ef830f tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:35:50.565161 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-50b3a77a-bd74-4e57-aace-338a28ef830f tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:35:50.566517 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-50b3a77a-bd74-4e57-aace-338a28ef830f tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] 10.222.0.30 "GET /compute/v2.1/servers/16226ccb-8bc4-43b6-abd5-7601be0e57b5" status: 200 len: 1721 microversion: 2.20 time: 0.253187 Jun 16 18:35:50.568806 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 354/739] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Jun 16 18:35:50 2022] GET /compute/v2.1/servers/16226ccb-8bc4-43b6-abd5-7601be0e57b5 => generated 1721 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:35:51.600097 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-3a1595bc-82dc-4a31-8ff5-8e4d423b4f48 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:35:51.614890 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-3a1595bc-82dc-4a31-8ff5-8e4d423b4f48 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] [instance: 16226ccb-8bc4-43b6-abd5-7601be0e57b5] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:35:51.626751 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-3a1595bc-82dc-4a31-8ff5-8e4d423b4f48 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:35:51.627323 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-3a1595bc-82dc-4a31-8ff5-8e4d423b4f48 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:35:51.628381 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-3a1595bc-82dc-4a31-8ff5-8e4d423b4f48 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:35:51.628863 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-3a1595bc-82dc-4a31-8ff5-8e4d423b4f48 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:35:52.039805 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-3a1595bc-82dc-4a31-8ff5-8e4d423b4f48 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:35:52.071078 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-3a1595bc-82dc-4a31-8ff5-8e4d423b4f48 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:35:52.074397 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-3a1595bc-82dc-4a31-8ff5-8e4d423b4f48 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:35:52.076732 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-3a1595bc-82dc-4a31-8ff5-8e4d423b4f48 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] 10.222.0.30 "GET /compute/v2.1/servers/16226ccb-8bc4-43b6-abd5-7601be0e57b5" status: 200 len: 1721 microversion: 2.20 time: 0.487577 Jun 16 18:35:52.077759 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 386/740] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Jun 16 18:35:51 2022] GET /compute/v2.1/servers/16226ccb-8bc4-43b6-abd5-7601be0e57b5 => generated 1721 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:35:53.131772 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [req-16510f8b-7197-46f9-a953-74b79931abaa req-784aa697-1d7b-4f8a-80bb-b77af347bdb4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16226ccb-8bc4-43b6-abd5-7601be0e57b5", "name": "network-vif-deleted", "tag": "fc74ff6c-f681-43e5-ba34-42732de13dac"}]} {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:35:53.148565 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-feada1d2-6af7-479c-9014-2ccd85d28a64 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:35:53.150924 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [req-16510f8b-7197-46f9-a953-74b79931abaa req-784aa697-1d7b-4f8a-80bb-b77af347bdb4 service nova] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:35:53.152268 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-feada1d2-6af7-479c-9014-2ccd85d28a64 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] [instance: 16226ccb-8bc4-43b6-abd5-7601be0e57b5] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:35:53.152835 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [req-16510f8b-7197-46f9-a953-74b79931abaa req-784aa697-1d7b-4f8a-80bb-b77af347bdb4 service nova] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:35:53.172723 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-feada1d2-6af7-479c-9014-2ccd85d28a64 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:35:53.173994 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-feada1d2-6af7-479c-9014-2ccd85d28a64 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:35:53.175398 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-feada1d2-6af7-479c-9014-2ccd85d28a64 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:35:53.177044 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-feada1d2-6af7-479c-9014-2ccd85d28a64 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:35:53.197635 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.compute.server_external_events [req-16510f8b-7197-46f9-a953-74b79931abaa req-784aa697-1d7b-4f8a-80bb-b77af347bdb4 service nova] Creating event network-vif-deleted:fc74ff6c-f681-43e5-ba34-42732de13dac for instance 16226ccb-8bc4-43b6-abd5-7601be0e57b5 on hv-cinder-81322 Jun 16 18:35:53.213145 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [req-16510f8b-7197-46f9-a953-74b79931abaa req-784aa697-1d7b-4f8a-80bb-b77af347bdb4 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088957 Jun 16 18:35:53.214523 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 387/741] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Jun 16 18:35:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 18:35:53.255091 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-a02ef8d6-0c7c-46c5-8f9e-55475cbc933c tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:35:53.257220 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-a02ef8d6-0c7c-46c5-8f9e-55475cbc933c tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] [instance: f116c8d4-a63e-47e1-bb50-ec64f735bfcc] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:35:53.283519 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-feada1d2-6af7-479c-9014-2ccd85d28a64 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:35:53.293107 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-a02ef8d6-0c7c-46c5-8f9e-55475cbc933c tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:35:53.296532 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-a02ef8d6-0c7c-46c5-8f9e-55475cbc933c tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:35:53.299829 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-a02ef8d6-0c7c-46c5-8f9e-55475cbc933c tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:35:53.302470 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-a02ef8d6-0c7c-46c5-8f9e-55475cbc933c tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:35:53.303959 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-feada1d2-6af7-479c-9014-2ccd85d28a64 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:35:53.309984 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-feada1d2-6af7-479c-9014-2ccd85d28a64 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73dc3ab6bc6448a89b26e3e1a1b5c6e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7904e707e39846fdb8b7d019719dc163', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:35:53.311666 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-feada1d2-6af7-479c-9014-2ccd85d28a64 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] 10.222.0.30 "GET /compute/v2.1/servers/16226ccb-8bc4-43b6-abd5-7601be0e57b5" status: 200 len: 1654 microversion: 2.20 time: 0.201942 Jun 16 18:35:53.312877 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 355/742] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Jun 16 18:35:53 2022] GET /compute/v2.1/servers/16226ccb-8bc4-43b6-abd5-7601be0e57b5 => generated 1654 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 18:35:53.352427 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-a02ef8d6-0c7c-46c5-8f9e-55475cbc933c tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] 10.222.0.30 "GET /compute/v2.1/servers/f116c8d4-a63e-47e1-bb50-ec64f735bfcc/ips" status: 200 len: 145 microversion: 2.1 time: 0.111941 Jun 16 18:35:53.353522 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 388/743] 10.222.0.30 () {58 vars in 1247 bytes} [Thu Jun 16 18:35:53 2022] GET /compute/v2.1/servers/f116c8d4-a63e-47e1-bb50-ec64f735bfcc/ips => generated 145 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:35:54.337002 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-c80a1a56-de04-4d3f-bf88-cf7023e6812b tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:35:54.338469 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-c80a1a56-de04-4d3f-bf88-cf7023e6812b tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] [instance: 16226ccb-8bc4-43b6-abd5-7601be0e57b5] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:35:54.347652 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-c80a1a56-de04-4d3f-bf88-cf7023e6812b tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:35:54.348532 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-c80a1a56-de04-4d3f-bf88-cf7023e6812b tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:35:54.350133 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-c80a1a56-de04-4d3f-bf88-cf7023e6812b tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:35:54.350879 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-c80a1a56-de04-4d3f-bf88-cf7023e6812b tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:35:54.370813 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.wsgi [None req-c80a1a56-de04-4d3f-bf88-cf7023e6812b tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] HTTP exception thrown: Instance 16226ccb-8bc4-43b6-abd5-7601be0e57b5 could not be found. Jun 16 18:35:54.372446 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-c80a1a56-de04-4d3f-bf88-cf7023e6812b tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Request method failure captured: Jun 16 18:35:54.372446 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: request: GET /compute/v2.1/servers/16226ccb-8bc4-43b6-abd5-7601be0e57b5 HTTP/1.1 Jun 16 18:35:54.372446 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: Accept: application/json Jun 16 18:35:54.372446 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: Accept-Encoding: identity Jun 16 18:35:54.372446 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: Connection: close Jun 16 18:35:54.372446 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: Content-Length: 0 Jun 16 18:35:54.372446 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: Content-Type: application/json Jun 16 18:35:54.372446 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: Host: 10.222.0.30 Jun 16 18:35:54.372446 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: Openstack-System-Scope: None Jun 16 18:35:54.372446 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: User-Agent: python-urllib3/1.26.9 Jun 16 18:35:54.372446 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Auth-Token: gAAAAABiq3ZbrtTEFerBg_JHOwUAGoYwgsE2GBTnZhTsj1cdmw0Q4mIQvXU36AW3oVsQBPVOAZ6bsT1Qj0N1aQ8g285FCL3-m_tLJacRbdHgFm_qnK-VV-9b3tCcyoi_LNqFe5D4bDveSC8XKG1FSEvNb7357tShtAEIWMmZv3lUgOlLhoVcpgY Jun 16 18:35:54.372446 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Domain-Id: None Jun 16 18:35:54.372446 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Domain-Name: None Jun 16 18:35:54.372446 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Identity-Status: Confirmed Jun 16 18:35:54.372446 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Is-Admin-Project: True Jun 16 18:35:54.372446 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Openstack-Nova-Api-Version: 2.20 Jun 16 18:35:54.372446 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Project-Domain-Id: default Jun 16 18:35:54.372446 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Project-Domain-Name: Default Jun 16 18:35:54.372446 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Project-Id: 7904e707e39846fdb8b7d019719dc163 Jun 16 18:35:54.372446 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1092341039 Jun 16 18:35:54.372446 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Role: reader,member Jun 16 18:35:54.372446 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Roles: reader,member Jun 16 18:35:54.375488 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/7904e707e39846fdb8b7d019719dc163"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/7904e707e39846fdb8b7d019719dc163"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_7904e707e39846fdb8b7d019719dc163", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/7904e707e39846fdb8b7d019719dc163"}]}] Jun 16 18:35:54.375488 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1092341039 Jun 16 18:35:54.375488 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Tenant-Id: 7904e707e39846fdb8b7d019719dc163 Jun 16 18:35:54.375488 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1092341039 Jun 16 18:35:54.375488 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-User: tempest-AttachVolumeShelveTestJSON-1092341039-project Jun 16 18:35:54.375488 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-User-Domain-Id: default Jun 16 18:35:54.375488 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-User-Domain-Name: Default Jun 16 18:35:54.375488 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-User-Id: 73dc3ab6bc6448a89b26e3e1a1b5c6e8 Jun 16 18:35:54.375488 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1092341039-project Jun 16 18:35:54.375488 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: method: > Jun 16 18:35:54.375488 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: exception: Instance 16226ccb-8bc4-43b6-abd5-7601be0e57b5 could not be found. Jun 16 18:35:54.375488 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: action_args: {'id': '16226ccb-8bc4-43b6-abd5-7601be0e57b5'} Jun 16 18:35:54.377266 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:35:54.377266 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:35:54.377266 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 18:35:54.377266 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 18:35:54.377266 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 18:35:54.377266 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 18:35:54.377266 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 18:35:54.377266 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 18:35:54.377266 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 18:35:54.377266 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 18:35:54.377266 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 16226ccb-8bc4-43b6-abd5-7601be0e57b5 could not be found. Jun 16 18:35:54.377266 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Jun 16 18:35:54.377266 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:35:54.377266 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Jun 16 18:35:54.377266 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:35:54.377266 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:35:54.377266 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:35:54.377266 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:35:54.377266 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:35:54.377266 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:35:54.380736 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:35:54.380736 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 18:35:54.380736 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 18:35:54.380736 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 18:35:54.380736 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 18:35:54.380736 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 18:35:54.380736 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:35:54.380736 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 16226ccb-8bc4-43b6-abd5-7601be0e57b5 could not be found. Jun 16 18:35:54.380736 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Jun 16 18:35:54.380736 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:35:54.380736 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Jun 16 18:35:54.380736 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:35:54.380736 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:35:54.380736 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:35:54.380736 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:35:54.380736 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:35:54.380736 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 16226ccb-8bc4-43b6-abd5-7601be0e57b5 could not be found. Jun 16 18:35:54.380736 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Jun 16 18:35:54.383207 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-c80a1a56-de04-4d3f-bf88-cf7023e6812b tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Returning 404 to user: Instance 16226ccb-8bc4-43b6-abd5-7601be0e57b5 could not be found. {{(pid=117671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:35:54.383207 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-c80a1a56-de04-4d3f-bf88-cf7023e6812b tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] 10.222.0.30 "GET /compute/v2.1/servers/16226ccb-8bc4-43b6-abd5-7601be0e57b5" status: 404 len: 111 microversion: 2.20 time: 0.044486 Jun 16 18:35:54.383207 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 356/744] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Jun 16 18:35:54 2022] GET /compute/v2.1/servers/16226ccb-8bc4-43b6-abd5-7601be0e57b5 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 16 18:35:54.388093 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-b9e20022-9d4b-4ca4-851e-95088ddc4795 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Calling method '.version_select at 0x7fbb34708af0>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:35:54.426555 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-b9e20022-9d4b-4ca4-851e-95088ddc4795 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-873981075" status: 204 len: 0 microversion: 2.20 time: 0.044592 Jun 16 18:35:54.427986 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 389/745] 10.222.0.30 () {60 vars in 1258 bytes} [Thu Jun 16 18:35:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-873981075 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 16 18:35:57.605834 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-207c6302-6cca-4503-903e-d0b24f2d4b17 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:35:57.606683 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-207c6302-6cca-4503-903e-d0b24f2d4b17 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] [instance: 16226ccb-8bc4-43b6-abd5-7601be0e57b5] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:35:57.621906 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-207c6302-6cca-4503-903e-d0b24f2d4b17 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:35:57.622588 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-207c6302-6cca-4503-903e-d0b24f2d4b17 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:35:57.624083 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-207c6302-6cca-4503-903e-d0b24f2d4b17 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:35:57.624971 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-207c6302-6cca-4503-903e-d0b24f2d4b17 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:35:57.656916 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.wsgi [None req-207c6302-6cca-4503-903e-d0b24f2d4b17 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] HTTP exception thrown: Instance 16226ccb-8bc4-43b6-abd5-7601be0e57b5 could not be found. Jun 16 18:35:57.661993 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-207c6302-6cca-4503-903e-d0b24f2d4b17 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Request method failure captured: Jun 16 18:35:57.661993 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: request: DELETE /compute/v2.1/servers/16226ccb-8bc4-43b6-abd5-7601be0e57b5 HTTP/1.1 Jun 16 18:35:57.661993 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: Accept: application/json Jun 16 18:35:57.661993 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: Accept-Encoding: identity Jun 16 18:35:57.661993 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: Connection: close Jun 16 18:35:57.661993 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: Content-Length: 0 Jun 16 18:35:57.661993 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: Content-Type: application/json Jun 16 18:35:57.661993 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: Host: 10.222.0.30 Jun 16 18:35:57.661993 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: Openstack-System-Scope: None Jun 16 18:35:57.661993 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: User-Agent: python-urllib3/1.26.9 Jun 16 18:35:57.661993 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Auth-Token: gAAAAABiq3ZbrtTEFerBg_JHOwUAGoYwgsE2GBTnZhTsj1cdmw0Q4mIQvXU36AW3oVsQBPVOAZ6bsT1Qj0N1aQ8g285FCL3-m_tLJacRbdHgFm_qnK-VV-9b3tCcyoi_LNqFe5D4bDveSC8XKG1FSEvNb7357tShtAEIWMmZv3lUgOlLhoVcpgY Jun 16 18:35:57.661993 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Domain-Id: None Jun 16 18:35:57.661993 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Domain-Name: None Jun 16 18:35:57.661993 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Identity-Status: Confirmed Jun 16 18:35:57.661993 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Is-Admin-Project: True Jun 16 18:35:57.661993 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Openstack-Nova-Api-Version: 2.20 Jun 16 18:35:57.661993 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Project-Domain-Id: default Jun 16 18:35:57.661993 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Project-Domain-Name: Default Jun 16 18:35:57.661993 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Project-Id: 7904e707e39846fdb8b7d019719dc163 Jun 16 18:35:57.661993 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1092341039 Jun 16 18:35:57.661993 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Role: reader,member Jun 16 18:35:57.661993 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Roles: reader,member Jun 16 18:35:57.663733 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/7904e707e39846fdb8b7d019719dc163"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/7904e707e39846fdb8b7d019719dc163"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_7904e707e39846fdb8b7d019719dc163", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/7904e707e39846fdb8b7d019719dc163"}]}] Jun 16 18:35:57.663733 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1092341039 Jun 16 18:35:57.663733 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Tenant-Id: 7904e707e39846fdb8b7d019719dc163 Jun 16 18:35:57.663733 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1092341039 Jun 16 18:35:57.663733 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-User: tempest-AttachVolumeShelveTestJSON-1092341039-project Jun 16 18:35:57.663733 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-User-Domain-Id: default Jun 16 18:35:57.663733 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-User-Domain-Name: Default Jun 16 18:35:57.663733 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-User-Id: 73dc3ab6bc6448a89b26e3e1a1b5c6e8 Jun 16 18:35:57.663733 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1092341039-project Jun 16 18:35:57.663733 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: method: > Jun 16 18:35:57.663733 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: exception: Instance 16226ccb-8bc4-43b6-abd5-7601be0e57b5 could not be found. Jun 16 18:35:57.663733 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: action_args: {'id': '16226ccb-8bc4-43b6-abd5-7601be0e57b5'} Jun 16 18:35:57.665146 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:35:57.665146 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:35:57.665146 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 18:35:57.665146 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 18:35:57.665146 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 18:35:57.665146 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 18:35:57.665146 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 18:35:57.665146 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 18:35:57.665146 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 18:35:57.665146 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 18:35:57.665146 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 16226ccb-8bc4-43b6-abd5-7601be0e57b5 could not be found. Jun 16 18:35:57.665146 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Jun 16 18:35:57.665146 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:35:57.665146 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Jun 16 18:35:57.665146 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:35:57.665146 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:35:57.665146 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:35:57.665146 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:35:57.665146 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:35:57.665146 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:35:57.667532 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:35:57.667532 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 16 18:35:57.667532 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 16 18:35:57.667532 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 16 18:35:57.667532 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 16 18:35:57.667532 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 18:35:57.667532 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 18:35:57.667532 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 18:35:57.667532 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:35:57.667532 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 16226ccb-8bc4-43b6-abd5-7601be0e57b5 could not be found. Jun 16 18:35:57.667532 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Jun 16 18:35:57.667532 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:35:57.667532 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Jun 16 18:35:57.667532 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:35:57.667532 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:35:57.667532 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:35:57.667532 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:35:57.667532 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:35:57.667532 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 16226ccb-8bc4-43b6-abd5-7601be0e57b5 could not be found. Jun 16 18:35:57.667532 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Jun 16 18:35:57.672929 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-207c6302-6cca-4503-903e-d0b24f2d4b17 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Returning 404 to user: Instance 16226ccb-8bc4-43b6-abd5-7601be0e57b5 could not be found. {{(pid=117671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:35:57.672929 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-207c6302-6cca-4503-903e-d0b24f2d4b17 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] 10.222.0.30 "DELETE /compute/v2.1/servers/16226ccb-8bc4-43b6-abd5-7601be0e57b5" status: 404 len: 111 microversion: 2.20 time: 0.067444 Jun 16 18:35:57.672929 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 357/746] 10.222.0.30 () {60 vars in 1279 bytes} [Thu Jun 16 18:35:57 2022] DELETE /compute/v2.1/servers/16226ccb-8bc4-43b6-abd5-7601be0e57b5 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 16 18:35:57.674782 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-b8e75603-a1f4-4d2b-800f-bc1e098805c0 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:35:57.675790 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-b8e75603-a1f4-4d2b-800f-bc1e098805c0 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] [instance: 16226ccb-8bc4-43b6-abd5-7601be0e57b5] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:35:57.683849 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-b8e75603-a1f4-4d2b-800f-bc1e098805c0 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:35:57.684333 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-b8e75603-a1f4-4d2b-800f-bc1e098805c0 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:35:57.685127 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-b8e75603-a1f4-4d2b-800f-bc1e098805c0 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:35:57.685672 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-b8e75603-a1f4-4d2b-800f-bc1e098805c0 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:35:57.702888 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.wsgi [None req-b8e75603-a1f4-4d2b-800f-bc1e098805c0 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] HTTP exception thrown: Instance 16226ccb-8bc4-43b6-abd5-7601be0e57b5 could not be found. Jun 16 18:35:57.704574 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-b8e75603-a1f4-4d2b-800f-bc1e098805c0 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Request method failure captured: Jun 16 18:35:57.704574 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: request: GET /compute/v2.1/servers/16226ccb-8bc4-43b6-abd5-7601be0e57b5 HTTP/1.1 Jun 16 18:35:57.704574 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: Accept: application/json Jun 16 18:35:57.704574 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: Accept-Encoding: identity Jun 16 18:35:57.704574 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: Connection: close Jun 16 18:35:57.704574 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: Content-Length: 0 Jun 16 18:35:57.704574 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: Content-Type: application/json Jun 16 18:35:57.704574 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: Host: 10.222.0.30 Jun 16 18:35:57.704574 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: Openstack-System-Scope: None Jun 16 18:35:57.704574 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: User-Agent: python-urllib3/1.26.9 Jun 16 18:35:57.704574 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Auth-Token: gAAAAABiq3ZbrtTEFerBg_JHOwUAGoYwgsE2GBTnZhTsj1cdmw0Q4mIQvXU36AW3oVsQBPVOAZ6bsT1Qj0N1aQ8g285FCL3-m_tLJacRbdHgFm_qnK-VV-9b3tCcyoi_LNqFe5D4bDveSC8XKG1FSEvNb7357tShtAEIWMmZv3lUgOlLhoVcpgY Jun 16 18:35:57.704574 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Domain-Id: None Jun 16 18:35:57.704574 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Domain-Name: None Jun 16 18:35:57.704574 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Identity-Status: Confirmed Jun 16 18:35:57.704574 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Is-Admin-Project: True Jun 16 18:35:57.704574 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Openstack-Nova-Api-Version: 2.20 Jun 16 18:35:57.704574 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Project-Domain-Id: default Jun 16 18:35:57.704574 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Project-Domain-Name: Default Jun 16 18:35:57.704574 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Project-Id: 7904e707e39846fdb8b7d019719dc163 Jun 16 18:35:57.704574 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1092341039 Jun 16 18:35:57.704574 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Role: reader,member Jun 16 18:35:57.704574 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Roles: reader,member Jun 16 18:35:57.708361 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/7904e707e39846fdb8b7d019719dc163"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/7904e707e39846fdb8b7d019719dc163"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_7904e707e39846fdb8b7d019719dc163", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/7904e707e39846fdb8b7d019719dc163"}]}] Jun 16 18:35:57.708361 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1092341039 Jun 16 18:35:57.708361 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Tenant-Id: 7904e707e39846fdb8b7d019719dc163 Jun 16 18:35:57.708361 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1092341039 Jun 16 18:35:57.708361 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-User: tempest-AttachVolumeShelveTestJSON-1092341039-project Jun 16 18:35:57.708361 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-User-Domain-Id: default Jun 16 18:35:57.708361 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-User-Domain-Name: Default Jun 16 18:35:57.708361 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-User-Id: 73dc3ab6bc6448a89b26e3e1a1b5c6e8 Jun 16 18:35:57.708361 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1092341039-project Jun 16 18:35:57.708361 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: method: > Jun 16 18:35:57.708361 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: exception: Instance 16226ccb-8bc4-43b6-abd5-7601be0e57b5 could not be found. Jun 16 18:35:57.708361 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: action_args: {'id': '16226ccb-8bc4-43b6-abd5-7601be0e57b5'} Jun 16 18:35:57.710836 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:35:57.710836 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:35:57.710836 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 18:35:57.710836 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 18:35:57.710836 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 18:35:57.710836 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 18:35:57.710836 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 18:35:57.710836 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 18:35:57.710836 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 18:35:57.710836 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 18:35:57.710836 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 16226ccb-8bc4-43b6-abd5-7601be0e57b5 could not be found. Jun 16 18:35:57.710836 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi Jun 16 18:35:57.710836 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:35:57.710836 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi Jun 16 18:35:57.710836 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:35:57.710836 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:35:57.710836 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:35:57.710836 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:35:57.710836 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:35:57.710836 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:35:57.713690 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:35:57.713690 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 18:35:57.713690 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 18:35:57.713690 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 18:35:57.713690 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 18:35:57.713690 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 18:35:57.713690 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:35:57.713690 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 16226ccb-8bc4-43b6-abd5-7601be0e57b5 could not be found. Jun 16 18:35:57.713690 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi Jun 16 18:35:57.713690 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:35:57.713690 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi Jun 16 18:35:57.713690 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:35:57.713690 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:35:57.713690 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:35:57.713690 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:35:57.713690 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:35:57.713690 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 16226ccb-8bc4-43b6-abd5-7601be0e57b5 could not be found. Jun 16 18:35:57.713690 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi Jun 16 18:35:57.716557 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-b8e75603-a1f4-4d2b-800f-bc1e098805c0 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Returning 404 to user: Instance 16226ccb-8bc4-43b6-abd5-7601be0e57b5 could not be found. {{(pid=117670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:35:57.716557 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-b8e75603-a1f4-4d2b-800f-bc1e098805c0 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] 10.222.0.30 "GET /compute/v2.1/servers/16226ccb-8bc4-43b6-abd5-7601be0e57b5" status: 404 len: 111 microversion: 2.20 time: 0.035353 Jun 16 18:35:57.716557 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 390/747] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Jun 16 18:35:57 2022] GET /compute/v2.1/servers/16226ccb-8bc4-43b6-abd5-7601be0e57b5 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jun 16 18:36:00.925644 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-f52113b2-8cb3-4cee-a4b3-4416cd17bc77 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8be68778-6f90-404c-8b9b-24d9ee261f1d"}} {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:36:00.927647 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-f52113b2-8cb3-4cee-a4b3-4416cd17bc77 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] [instance: f116c8d4-a63e-47e1-bb50-ec64f735bfcc] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:36:00.937438 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-f52113b2-8cb3-4cee-a4b3-4416cd17bc77 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:36:00.938121 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-f52113b2-8cb3-4cee-a4b3-4416cd17bc77 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:36:00.939047 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-f52113b2-8cb3-4cee-a4b3-4416cd17bc77 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:36:00.939668 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-f52113b2-8cb3-4cee-a4b3-4416cd17bc77 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:36:01.028258 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-7399cf9f-a668-4a29-8f93-582c2fa8524a tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:36:01.029176 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-7399cf9f-a668-4a29-8f93-582c2fa8524a tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] [instance: 651b5fe1-0df7-4bc6-b18e-7caea544a93f] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:36:01.044676 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-7399cf9f-a668-4a29-8f93-582c2fa8524a tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:36:01.045470 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-7399cf9f-a668-4a29-8f93-582c2fa8524a tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:36:01.046899 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-7399cf9f-a668-4a29-8f93-582c2fa8524a tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:36:01.047747 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-7399cf9f-a668-4a29-8f93-582c2fa8524a tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:36:01.076770 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.wsgi [None req-7399cf9f-a668-4a29-8f93-582c2fa8524a tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] HTTP exception thrown: Instance 651b5fe1-0df7-4bc6-b18e-7caea544a93f could not be found. Jun 16 18:36:01.078509 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-7399cf9f-a668-4a29-8f93-582c2fa8524a tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Request method failure captured: Jun 16 18:36:01.078509 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: request: DELETE /compute/v2.1/servers/651b5fe1-0df7-4bc6-b18e-7caea544a93f HTTP/1.1 Jun 16 18:36:01.078509 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: Accept: application/json Jun 16 18:36:01.078509 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: Accept-Encoding: identity Jun 16 18:36:01.078509 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: Connection: close Jun 16 18:36:01.078509 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: Content-Length: 0 Jun 16 18:36:01.078509 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: Content-Type: application/json Jun 16 18:36:01.078509 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: Host: 10.222.0.30 Jun 16 18:36:01.078509 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: Openstack-System-Scope: None Jun 16 18:36:01.078509 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: User-Agent: python-urllib3/1.26.9 Jun 16 18:36:01.078509 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Auth-Token: gAAAAABiq3ZbrtTEFerBg_JHOwUAGoYwgsE2GBTnZhTsj1cdmw0Q4mIQvXU36AW3oVsQBPVOAZ6bsT1Qj0N1aQ8g285FCL3-m_tLJacRbdHgFm_qnK-VV-9b3tCcyoi_LNqFe5D4bDveSC8XKG1FSEvNb7357tShtAEIWMmZv3lUgOlLhoVcpgY Jun 16 18:36:01.078509 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Domain-Id: None Jun 16 18:36:01.078509 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Domain-Name: None Jun 16 18:36:01.078509 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Identity-Status: Confirmed Jun 16 18:36:01.078509 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Is-Admin-Project: True Jun 16 18:36:01.078509 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Openstack-Nova-Api-Version: 2.20 Jun 16 18:36:01.078509 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Project-Domain-Id: default Jun 16 18:36:01.078509 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Project-Domain-Name: Default Jun 16 18:36:01.078509 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Project-Id: 7904e707e39846fdb8b7d019719dc163 Jun 16 18:36:01.078509 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1092341039 Jun 16 18:36:01.078509 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Role: reader,member Jun 16 18:36:01.078509 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Roles: reader,member Jun 16 18:36:01.081483 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/7904e707e39846fdb8b7d019719dc163"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/7904e707e39846fdb8b7d019719dc163"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_7904e707e39846fdb8b7d019719dc163", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/7904e707e39846fdb8b7d019719dc163"}]}] Jun 16 18:36:01.081483 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1092341039 Jun 16 18:36:01.081483 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Tenant-Id: 7904e707e39846fdb8b7d019719dc163 Jun 16 18:36:01.081483 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1092341039 Jun 16 18:36:01.081483 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-User: tempest-AttachVolumeShelveTestJSON-1092341039-project Jun 16 18:36:01.081483 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-User-Domain-Id: default Jun 16 18:36:01.081483 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-User-Domain-Name: Default Jun 16 18:36:01.081483 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-User-Id: 73dc3ab6bc6448a89b26e3e1a1b5c6e8 Jun 16 18:36:01.081483 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1092341039-project Jun 16 18:36:01.081483 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: method: > Jun 16 18:36:01.081483 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: exception: Instance 651b5fe1-0df7-4bc6-b18e-7caea544a93f could not be found. Jun 16 18:36:01.081483 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: action_args: {'id': '651b5fe1-0df7-4bc6-b18e-7caea544a93f'} Jun 16 18:36:01.083614 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:36:01.083614 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:36:01.083614 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 18:36:01.083614 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 18:36:01.083614 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 18:36:01.083614 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 18:36:01.083614 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 18:36:01.083614 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 18:36:01.083614 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 18:36:01.083614 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 18:36:01.083614 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 651b5fe1-0df7-4bc6-b18e-7caea544a93f could not be found. Jun 16 18:36:01.083614 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi Jun 16 18:36:01.083614 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:36:01.083614 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi Jun 16 18:36:01.083614 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:36:01.083614 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:36:01.083614 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:36:01.083614 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:36:01.083614 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:36:01.083614 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:36:01.086013 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:36:01.086013 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 16 18:36:01.086013 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 16 18:36:01.086013 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 16 18:36:01.086013 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 16 18:36:01.086013 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 18:36:01.086013 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 18:36:01.086013 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 18:36:01.086013 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:36:01.086013 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 651b5fe1-0df7-4bc6-b18e-7caea544a93f could not be found. Jun 16 18:36:01.086013 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi Jun 16 18:36:01.086013 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:36:01.086013 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi Jun 16 18:36:01.086013 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:36:01.086013 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:36:01.086013 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:36:01.086013 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:36:01.086013 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:36:01.086013 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 651b5fe1-0df7-4bc6-b18e-7caea544a93f could not be found. Jun 16 18:36:01.086013 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi Jun 16 18:36:01.089505 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-7399cf9f-a668-4a29-8f93-582c2fa8524a tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Returning 404 to user: Instance 651b5fe1-0df7-4bc6-b18e-7caea544a93f could not be found. {{(pid=117670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:36:01.089505 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-7399cf9f-a668-4a29-8f93-582c2fa8524a tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] 10.222.0.30 "DELETE /compute/v2.1/servers/651b5fe1-0df7-4bc6-b18e-7caea544a93f" status: 404 len: 111 microversion: 2.20 time: 0.057164 Jun 16 18:36:01.089505 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 391/748] 10.222.0.30 () {60 vars in 1279 bytes} [Thu Jun 16 18:36:01 2022] DELETE /compute/v2.1/servers/651b5fe1-0df7-4bc6-b18e-7caea544a93f => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jun 16 18:36:01.096585 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-8d123bc1-7001-4c05-9e47-b5693511cb90 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:36:01.098473 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-8d123bc1-7001-4c05-9e47-b5693511cb90 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] [instance: 651b5fe1-0df7-4bc6-b18e-7caea544a93f] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:36:01.110625 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-8d123bc1-7001-4c05-9e47-b5693511cb90 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:36:01.111500 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-8d123bc1-7001-4c05-9e47-b5693511cb90 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:36:01.112498 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-8d123bc1-7001-4c05-9e47-b5693511cb90 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:36:01.113020 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-8d123bc1-7001-4c05-9e47-b5693511cb90 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:36:01.133736 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.wsgi [None req-8d123bc1-7001-4c05-9e47-b5693511cb90 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] HTTP exception thrown: Instance 651b5fe1-0df7-4bc6-b18e-7caea544a93f could not be found. Jun 16 18:36:01.136537 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-8d123bc1-7001-4c05-9e47-b5693511cb90 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Request method failure captured: Jun 16 18:36:01.136537 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: request: GET /compute/v2.1/servers/651b5fe1-0df7-4bc6-b18e-7caea544a93f HTTP/1.1 Jun 16 18:36:01.136537 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: Accept: application/json Jun 16 18:36:01.136537 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: Accept-Encoding: identity Jun 16 18:36:01.136537 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: Connection: close Jun 16 18:36:01.136537 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: Content-Length: 0 Jun 16 18:36:01.136537 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: Content-Type: application/json Jun 16 18:36:01.136537 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: Host: 10.222.0.30 Jun 16 18:36:01.136537 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: Openstack-System-Scope: None Jun 16 18:36:01.136537 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: User-Agent: python-urllib3/1.26.9 Jun 16 18:36:01.136537 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Auth-Token: gAAAAABiq3ZbrtTEFerBg_JHOwUAGoYwgsE2GBTnZhTsj1cdmw0Q4mIQvXU36AW3oVsQBPVOAZ6bsT1Qj0N1aQ8g285FCL3-m_tLJacRbdHgFm_qnK-VV-9b3tCcyoi_LNqFe5D4bDveSC8XKG1FSEvNb7357tShtAEIWMmZv3lUgOlLhoVcpgY Jun 16 18:36:01.136537 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Domain-Id: None Jun 16 18:36:01.136537 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Domain-Name: None Jun 16 18:36:01.136537 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Identity-Status: Confirmed Jun 16 18:36:01.136537 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Is-Admin-Project: True Jun 16 18:36:01.136537 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Openstack-Nova-Api-Version: 2.20 Jun 16 18:36:01.136537 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Project-Domain-Id: default Jun 16 18:36:01.136537 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Project-Domain-Name: Default Jun 16 18:36:01.136537 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Project-Id: 7904e707e39846fdb8b7d019719dc163 Jun 16 18:36:01.136537 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1092341039 Jun 16 18:36:01.136537 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Role: reader,member Jun 16 18:36:01.136537 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Roles: reader,member Jun 16 18:36:01.138240 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/7904e707e39846fdb8b7d019719dc163"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/7904e707e39846fdb8b7d019719dc163"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_7904e707e39846fdb8b7d019719dc163", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/7904e707e39846fdb8b7d019719dc163"}]}] Jun 16 18:36:01.138240 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1092341039 Jun 16 18:36:01.138240 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Tenant-Id: 7904e707e39846fdb8b7d019719dc163 Jun 16 18:36:01.138240 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1092341039 Jun 16 18:36:01.138240 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-User: tempest-AttachVolumeShelveTestJSON-1092341039-project Jun 16 18:36:01.138240 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-User-Domain-Id: default Jun 16 18:36:01.138240 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-User-Domain-Name: Default Jun 16 18:36:01.138240 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-User-Id: 73dc3ab6bc6448a89b26e3e1a1b5c6e8 Jun 16 18:36:01.138240 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1092341039-project Jun 16 18:36:01.138240 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: method: > Jun 16 18:36:01.138240 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: exception: Instance 651b5fe1-0df7-4bc6-b18e-7caea544a93f could not be found. Jun 16 18:36:01.138240 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: action_args: {'id': '651b5fe1-0df7-4bc6-b18e-7caea544a93f'} Jun 16 18:36:01.138996 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:36:01.138996 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:36:01.138996 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 18:36:01.138996 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 18:36:01.138996 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 18:36:01.138996 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 18:36:01.138996 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 18:36:01.138996 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 18:36:01.138996 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 18:36:01.138996 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 18:36:01.138996 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 651b5fe1-0df7-4bc6-b18e-7caea544a93f could not be found. Jun 16 18:36:01.138996 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi Jun 16 18:36:01.138996 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:36:01.138996 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi Jun 16 18:36:01.138996 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:36:01.138996 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:36:01.138996 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:36:01.138996 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:36:01.138996 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:36:01.138996 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:36:01.141659 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:36:01.141659 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 18:36:01.141659 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 18:36:01.141659 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 18:36:01.141659 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 18:36:01.141659 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 18:36:01.141659 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:36:01.141659 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 651b5fe1-0df7-4bc6-b18e-7caea544a93f could not be found. Jun 16 18:36:01.141659 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi Jun 16 18:36:01.141659 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:36:01.141659 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi Jun 16 18:36:01.141659 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:36:01.141659 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:36:01.141659 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:36:01.141659 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:36:01.141659 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:36:01.141659 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 651b5fe1-0df7-4bc6-b18e-7caea544a93f could not be found. Jun 16 18:36:01.141659 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi Jun 16 18:36:01.143390 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-8d123bc1-7001-4c05-9e47-b5693511cb90 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] Returning 404 to user: Instance 651b5fe1-0df7-4bc6-b18e-7caea544a93f could not be found. {{(pid=117670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:36:01.143390 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-8d123bc1-7001-4c05-9e47-b5693511cb90 tempest-AttachVolumeShelveTestJSON-1092341039 tempest-AttachVolumeShelveTestJSON-1092341039-project] 10.222.0.30 "GET /compute/v2.1/servers/651b5fe1-0df7-4bc6-b18e-7caea544a93f" status: 404 len: 111 microversion: 2.20 time: 0.050265 Jun 16 18:36:01.143390 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 392/749] 10.222.0.30 () {60 vars in 1276 bytes} [Thu Jun 16 18:36:01 2022] GET /compute/v2.1/servers/651b5fe1-0df7-4bc6-b18e-7caea544a93f => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jun 16 18:36:01.376330 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-f52113b2-8cb3-4cee-a4b3-4416cd17bc77 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] 10.222.0.30 "POST /compute/v2.1/servers/f116c8d4-a63e-47e1-bb50-ec64f735bfcc/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.453641 Jun 16 18:36:01.385174 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 358/750] 10.222.0.30 () {60 vars in 1322 bytes} [Thu Jun 16 18:36:00 2022] POST /compute/v2.1/servers/f116c8d4-a63e-47e1-bb50-ec64f735bfcc/os-volume_attachments => generated 194 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 18:36:08.074417 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-68e9d2bf-f85c-474d-9a12-238b6e1fd095 tempest-VolumesGetTestJSON-978684066 tempest-VolumesGetTestJSON-978684066-project] Action: 'create', calling method: .version_select at 0x7fbb3470dc10>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-719141034", "metadata": {"Type": "work"}}} {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:36:08.216883 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-796f3685-21ba-4539-9d83-40a086e010d8 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:36:08.227517 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-796f3685-21ba-4539-9d83-40a086e010d8 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:36:08.228316 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-796f3685-21ba-4539-9d83-40a086e010d8 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:36:08.337740 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-796f3685-21ba-4539-9d83-40a086e010d8 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] [instance: f116c8d4-a63e-47e1-bb50-ec64f735bfcc] Going to try to stop instance {{(pid=117671) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 16 18:36:08.403768 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-796f3685-21ba-4539-9d83-40a086e010d8 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] 10.222.0.30 "POST /compute/v2.1/servers/f116c8d4-a63e-47e1-bb50-ec64f735bfcc/action" status: 202 len: 0 microversion: 2.1 time: 0.194777 Jun 16 18:36:08.404754 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 359/751] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Jun 16 18:36:08 2022] POST /compute/v2.1/servers/f116c8d4-a63e-47e1-bb50-ec64f735bfcc/action => generated 0 bytes in 198 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 16 18:36:08.416124 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-87c71e8e-312d-4077-a55e-5042574b9f18 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:36:08.416849 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-87c71e8e-312d-4077-a55e-5042574b9f18 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] [instance: f116c8d4-a63e-47e1-bb50-ec64f735bfcc] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:36:08.425220 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-87c71e8e-312d-4077-a55e-5042574b9f18 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:36:08.426333 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-87c71e8e-312d-4077-a55e-5042574b9f18 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:36:08.427387 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-87c71e8e-312d-4077-a55e-5042574b9f18 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:36:08.427956 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-87c71e8e-312d-4077-a55e-5042574b9f18 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:36:08.559032 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-68e9d2bf-f85c-474d-9a12-238b6e1fd095 tempest-VolumesGetTestJSON-978684066 tempest-VolumesGetTestJSON-978684066-project] 10.222.0.30 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 0.627385 Jun 16 18:36:08.564140 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 393/752] 10.222.0.30 () {60 vars in 1155 bytes} [Thu Jun 16 18:36:07 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 631 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Jun 16 18:36:08.578533 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-9d8fc8bf-fcdd-46fd-bda5-432e60f932a5 tempest-VolumesGetTestJSON-978684066 tempest-VolumesGetTestJSON-978684066-project] Calling method '.version_select at 0x7fbb23e6f040>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:36:08.653198 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-9d8fc8bf-fcdd-46fd-bda5-432e60f932a5 tempest-VolumesGetTestJSON-978684066 tempest-VolumesGetTestJSON-978684066-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/372a4f47-8f4b-4d8e-ab99-65350aee24bb" status: 200 len: 352 microversion: 2.1 time: 0.084375 Jun 16 18:36:08.654138 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 394/753] 10.222.0.30 () {58 vars in 1244 bytes} [Thu Jun 16 18:36:08 2022] GET /compute/v2.1/os-volumes/372a4f47-8f4b-4d8e-ab99-65350aee24bb => generated 352 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 18:36:08.678858 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-87c71e8e-312d-4077-a55e-5042574b9f18 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebdf8e3cd1b44dcba37cdcfb4af7db2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a8e1d26bdfc400ebd1e070b09db615e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:36:08.691279 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-87c71e8e-312d-4077-a55e-5042574b9f18 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] 10.222.0.30 "GET /compute/v2.1/servers/f116c8d4-a63e-47e1-bb50-ec64f735bfcc" status: 200 len: 1723 microversion: 2.1 time: 0.279430 Jun 16 18:36:08.692823 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 360/754] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:36:08 2022] GET /compute/v2.1/servers/f116c8d4-a63e-47e1-bb50-ec64f735bfcc => generated 1723 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:36:09.672306 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-781fcaf5-e6db-45f4-8496-3701445de659 tempest-VolumesGetTestJSON-978684066 tempest-VolumesGetTestJSON-978684066-project] Calling method '.version_select at 0x7fbb346d24c0>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:36:09.723056 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-5c5393d1-b8d3-4281-b922-1526d9ec39f9 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:36:09.724154 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-5c5393d1-b8d3-4281-b922-1526d9ec39f9 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] [instance: f116c8d4-a63e-47e1-bb50-ec64f735bfcc] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:36:09.731182 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-5c5393d1-b8d3-4281-b922-1526d9ec39f9 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:36:09.731630 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-5c5393d1-b8d3-4281-b922-1526d9ec39f9 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:36:09.732446 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-5c5393d1-b8d3-4281-b922-1526d9ec39f9 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:36:09.732974 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-5c5393d1-b8d3-4281-b922-1526d9ec39f9 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:36:09.737263 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-781fcaf5-e6db-45f4-8496-3701445de659 tempest-VolumesGetTestJSON-978684066 tempest-VolumesGetTestJSON-978684066-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/372a4f47-8f4b-4d8e-ab99-65350aee24bb" status: 200 len: 353 microversion: 2.1 time: 0.070421 Jun 16 18:36:09.738153 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 395/755] 10.222.0.30 () {58 vars in 1244 bytes} [Thu Jun 16 18:36:09 2022] GET /compute/v2.1/os-volumes/372a4f47-8f4b-4d8e-ab99-65350aee24bb => generated 353 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:36:09.750057 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-8d8478a5-4857-4d10-a656-f4bdf2785ff2 tempest-VolumesGetTestJSON-978684066 tempest-VolumesGetTestJSON-978684066-project] Calling method '.version_select at 0x7fbb3470d310>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:36:09.808920 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-8d8478a5-4857-4d10-a656-f4bdf2785ff2 tempest-VolumesGetTestJSON-978684066 tempest-VolumesGetTestJSON-978684066-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/372a4f47-8f4b-4d8e-ab99-65350aee24bb" status: 200 len: 353 microversion: 2.1 time: 0.063098 Jun 16 18:36:09.809805 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 396/756] 10.222.0.30 () {58 vars in 1244 bytes} [Thu Jun 16 18:36:09 2022] GET /compute/v2.1/os-volumes/372a4f47-8f4b-4d8e-ab99-65350aee24bb => generated 353 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 18:36:09.826331 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-3963a20b-ed63-4bf8-9090-1b1e844fa5a9 tempest-VolumesGetTestJSON-978684066 tempest-VolumesGetTestJSON-978684066-project] Calling method '.version_select at 0x7fbb3471af70>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:36:09.900355 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-3963a20b-ed63-4bf8-9090-1b1e844fa5a9 tempest-VolumesGetTestJSON-978684066 tempest-VolumesGetTestJSON-978684066-project] 10.222.0.30 "DELETE /compute/v2.1/os-volumes/372a4f47-8f4b-4d8e-ab99-65350aee24bb" status: 202 len: 0 microversion: 2.1 time: 0.077546 Jun 16 18:36:09.900790 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 397/757] 10.222.0.30 () {58 vars in 1247 bytes} [Thu Jun 16 18:36:09 2022] DELETE /compute/v2.1/os-volumes/372a4f47-8f4b-4d8e-ab99-65350aee24bb => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 16 18:36:09.909538 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-37bd01ab-05c2-41a2-bf58-782675a3ec68 tempest-VolumesGetTestJSON-978684066 tempest-VolumesGetTestJSON-978684066-project] Calling method '.version_select at 0x7fbb34756dc0>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:36:09.965080 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-5c5393d1-b8d3-4281-b922-1526d9ec39f9 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebdf8e3cd1b44dcba37cdcfb4af7db2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a8e1d26bdfc400ebd1e070b09db615e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:36:09.976471 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-37bd01ab-05c2-41a2-bf58-782675a3ec68 tempest-VolumesGetTestJSON-978684066 tempest-VolumesGetTestJSON-978684066-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/372a4f47-8f4b-4d8e-ab99-65350aee24bb" status: 200 len: 352 microversion: 2.1 time: 0.070888 Jun 16 18:36:09.977063 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 398/758] 10.222.0.30 () {58 vars in 1244 bytes} [Thu Jun 16 18:36:09 2022] GET /compute/v2.1/os-volumes/372a4f47-8f4b-4d8e-ab99-65350aee24bb => generated 352 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 18:36:09.982349 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-5c5393d1-b8d3-4281-b922-1526d9ec39f9 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] 10.222.0.30 "GET /compute/v2.1/servers/f116c8d4-a63e-47e1-bb50-ec64f735bfcc" status: 200 len: 1723 microversion: 2.1 time: 0.266246 Jun 16 18:36:09.983421 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 361/759] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:36:09 2022] GET /compute/v2.1/servers/f116c8d4-a63e-47e1-bb50-ec64f735bfcc => generated 1723 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:36:10.991507 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-4396f292-6597-4624-8abb-7a26cf602512 tempest-VolumesGetTestJSON-978684066 tempest-VolumesGetTestJSON-978684066-project] Calling method '.version_select at 0x7fbb23dce040>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:36:11.006648 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-c050fcf9-faf0-4311-adab-0ab070289b68 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:36:11.007648 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-c050fcf9-faf0-4311-adab-0ab070289b68 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] [instance: f116c8d4-a63e-47e1-bb50-ec64f735bfcc] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:36:11.021316 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-c050fcf9-faf0-4311-adab-0ab070289b68 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:36:11.021800 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-c050fcf9-faf0-4311-adab-0ab070289b68 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:36:11.023148 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-c050fcf9-faf0-4311-adab-0ab070289b68 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:36:11.023897 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-c050fcf9-faf0-4311-adab-0ab070289b68 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:36:11.024784 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.wsgi [None req-4396f292-6597-4624-8abb-7a26cf602512 tempest-VolumesGetTestJSON-978684066 tempest-VolumesGetTestJSON-978684066-project] HTTP exception thrown: Volume 372a4f47-8f4b-4d8e-ab99-65350aee24bb could not be found. Jun 16 18:36:11.027114 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-4396f292-6597-4624-8abb-7a26cf602512 tempest-VolumesGetTestJSON-978684066 tempest-VolumesGetTestJSON-978684066-project] Request method failure captured: Jun 16 18:36:11.027114 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: request: GET /compute/v2.1/os-volumes/372a4f47-8f4b-4d8e-ab99-65350aee24bb HTTP/1.1 Jun 16 18:36:11.027114 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: Accept: application/json Jun 16 18:36:11.027114 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: Accept-Encoding: identity Jun 16 18:36:11.027114 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: Connection: close Jun 16 18:36:11.027114 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: Content-Length: 0 Jun 16 18:36:11.027114 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: Content-Type: application/json Jun 16 18:36:11.027114 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: Host: 10.222.0.30 Jun 16 18:36:11.027114 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: Openstack-System-Scope: None Jun 16 18:36:11.027114 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: User-Agent: python-urllib3/1.26.9 Jun 16 18:36:11.027114 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Auth-Token: gAAAAABiq3gXtHj4CRU4JDptoR-FO4BajDUseFzTaQ8ONQANtMFnArCEbmb2fCAKLbGcZJ5Fm2nfBPkXuWAEwbfZuZZmeRhk34CYTy7-y2uJ3JNH8MhYS4GPBRFuIdg322v9oD8D95vQP_Hd_7-q3moxZfnzIx96PtWFgQcdb9sPAvvToTM25j0 Jun 16 18:36:11.027114 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Domain-Id: None Jun 16 18:36:11.027114 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Domain-Name: None Jun 16 18:36:11.027114 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Identity-Status: Confirmed Jun 16 18:36:11.027114 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Is-Admin-Project: True Jun 16 18:36:11.027114 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Project-Domain-Id: default Jun 16 18:36:11.027114 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Project-Domain-Name: Default Jun 16 18:36:11.027114 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Project-Id: 91efbe839c644278a79556ae257a9fd8 Jun 16 18:36:11.027114 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Project-Name: tempest-VolumesGetTestJSON-978684066 Jun 16 18:36:11.027114 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Role: reader,member Jun 16 18:36:11.027114 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Roles: reader,member Jun 16 18:36:11.029620 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/91efbe839c644278a79556ae257a9fd8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/91efbe839c644278a79556ae257a9fd8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_91efbe839c644278a79556ae257a9fd8", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/91efbe839c644278a79556ae257a9fd8"}]}] Jun 16 18:36:11.029620 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Tenant: tempest-VolumesGetTestJSON-978684066 Jun 16 18:36:11.029620 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Tenant-Id: 91efbe839c644278a79556ae257a9fd8 Jun 16 18:36:11.029620 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Tenant-Name: tempest-VolumesGetTestJSON-978684066 Jun 16 18:36:11.029620 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-User: tempest-VolumesGetTestJSON-978684066-project Jun 16 18:36:11.029620 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-User-Domain-Id: default Jun 16 18:36:11.029620 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-User-Domain-Name: Default Jun 16 18:36:11.029620 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-User-Id: 939ecba77c3b4caf9d6908a71f83f66c Jun 16 18:36:11.029620 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-User-Name: tempest-VolumesGetTestJSON-978684066-project Jun 16 18:36:11.029620 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: method: Jun 16 18:36:11.029620 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: exception: Volume 372a4f47-8f4b-4d8e-ab99-65350aee24bb could not be found. Jun 16 18:36:11.029620 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: action_args: {'id': '372a4f47-8f4b-4d8e-ab99-65350aee24bb'} Jun 16 18:36:11.029620 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:36:11.031935 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:36:11.031935 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 16 18:36:11.031935 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 16 18:36:11.031935 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 16 18:36:11.031935 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 16 18:36:11.031935 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 16 18:36:11.031935 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 16 18:36:11.031935 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 16 18:36:11.031935 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 16 18:36:11.031935 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 16 18:36:11.031935 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 16 18:36:11.031935 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 18:36:11.031935 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 18:36:11.031935 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 18:36:11.031935 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 18:36:11.031935 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 372a4f47-8f4b-4d8e-ab99-65350aee24bb could not be found. (HTTP 404) (Request-ID: req-89087416-68ed-4ea6-be36-fd1f97d59061) Jun 16 18:36:11.031935 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi Jun 16 18:36:11.031935 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:36:11.031935 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi Jun 16 18:36:11.034940 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:36:11.034940 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 16 18:36:11.034940 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 16 18:36:11.034940 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 16 18:36:11.034940 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 16 18:36:11.034940 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 16 18:36:11.034940 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 16 18:36:11.034940 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 16 18:36:11.034940 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 16 18:36:11.034940 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 16 18:36:11.034940 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 16 18:36:11.034940 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 16 18:36:11.034940 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 16 18:36:11.034940 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 16 18:36:11.034940 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 16 18:36:11.034940 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 16 18:36:11.034940 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 16 18:36:11.034940 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 16 18:36:11.034940 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 16 18:36:11.038172 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 18:36:11.038172 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 18:36:11.038172 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 18:36:11.038172 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 18:36:11.038172 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 372a4f47-8f4b-4d8e-ab99-65350aee24bb could not be found. Jun 16 18:36:11.038172 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi Jun 16 18:36:11.038172 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:36:11.038172 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi Jun 16 18:36:11.038172 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:36:11.038172 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:36:11.038172 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:36:11.038172 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:36:11.038172 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:36:11.038172 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 18:36:11.038172 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 18:36:11.038172 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:36:11.038172 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:36:11.038172 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 16 18:36:11.038172 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:36:11.039692 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 372a4f47-8f4b-4d8e-ab99-65350aee24bb could not be found. Jun 16 18:36:11.039692 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi Jun 16 18:36:11.039692 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:36:11.039692 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi Jun 16 18:36:11.039692 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:36:11.039692 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:36:11.039692 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:36:11.039692 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:36:11.039692 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:36:11.039692 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 372a4f47-8f4b-4d8e-ab99-65350aee24bb could not be found. Jun 16 18:36:11.039692 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi Jun 16 18:36:11.039692 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-4396f292-6597-4624-8abb-7a26cf602512 tempest-VolumesGetTestJSON-978684066 tempest-VolumesGetTestJSON-978684066-project] Returning 404 to user: Volume 372a4f47-8f4b-4d8e-ab99-65350aee24bb could not be found. {{(pid=117670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:36:11.039692 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-4396f292-6597-4624-8abb-7a26cf602512 tempest-VolumesGetTestJSON-978684066 tempest-VolumesGetTestJSON-978684066-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/372a4f47-8f4b-4d8e-ab99-65350aee24bb" status: 404 len: 109 microversion: 2.1 time: 0.044325 Jun 16 18:36:11.039692 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 399/760] 10.222.0.30 () {58 vars in 1244 bytes} [Thu Jun 16 18:36:10 2022] GET /compute/v2.1/os-volumes/372a4f47-8f4b-4d8e-ab99-65350aee24bb => generated 109 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:36:11.244622 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-c050fcf9-faf0-4311-adab-0ab070289b68 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebdf8e3cd1b44dcba37cdcfb4af7db2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a8e1d26bdfc400ebd1e070b09db615e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:36:11.261137 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-c050fcf9-faf0-4311-adab-0ab070289b68 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] 10.222.0.30 "GET /compute/v2.1/servers/f116c8d4-a63e-47e1-bb50-ec64f735bfcc" status: 200 len: 1723 microversion: 2.1 time: 0.261897 Jun 16 18:36:11.262721 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 362/761] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:36:10 2022] GET /compute/v2.1/servers/f116c8d4-a63e-47e1-bb50-ec64f735bfcc => generated 1723 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:36:12.288422 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG dbcounter [-] [117670] Writing DB stats nova_api:SELECT=22,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=117670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:12.289950 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG dbcounter [-] [117670] Writing DB stats nova_cell1:SELECT=32,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:12.296431 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-1867fc77-5cd0-4ec9-b7bf-fc77c40816cd tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:36:12.297211 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-1867fc77-5cd0-4ec9-b7bf-fc77c40816cd tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] [instance: f116c8d4-a63e-47e1-bb50-ec64f735bfcc] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:36:12.306160 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-1867fc77-5cd0-4ec9-b7bf-fc77c40816cd tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:36:12.306614 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-1867fc77-5cd0-4ec9-b7bf-fc77c40816cd tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:36:12.307414 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-1867fc77-5cd0-4ec9-b7bf-fc77c40816cd tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:36:12.307860 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-1867fc77-5cd0-4ec9-b7bf-fc77c40816cd tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:36:12.572267 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-1867fc77-5cd0-4ec9-b7bf-fc77c40816cd tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebdf8e3cd1b44dcba37cdcfb4af7db2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a8e1d26bdfc400ebd1e070b09db615e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:36:12.581507 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-1867fc77-5cd0-4ec9-b7bf-fc77c40816cd tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] 10.222.0.30 "GET /compute/v2.1/servers/f116c8d4-a63e-47e1-bb50-ec64f735bfcc" status: 200 len: 1723 microversion: 2.1 time: 0.295015 Jun 16 18:36:12.582899 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 400/762] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:36:12 2022] GET /compute/v2.1/servers/f116c8d4-a63e-47e1-bb50-ec64f735bfcc => generated 1723 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:36:13.605424 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-8e7588f5-42e4-4df8-96d3-97cda9a16a66 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:36:13.606442 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-8e7588f5-42e4-4df8-96d3-97cda9a16a66 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] [instance: f116c8d4-a63e-47e1-bb50-ec64f735bfcc] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:36:13.620576 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-8e7588f5-42e4-4df8-96d3-97cda9a16a66 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:36:13.621674 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-8e7588f5-42e4-4df8-96d3-97cda9a16a66 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:36:13.623089 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-8e7588f5-42e4-4df8-96d3-97cda9a16a66 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:36:13.623808 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-8e7588f5-42e4-4df8-96d3-97cda9a16a66 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:36:13.873817 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-8e7588f5-42e4-4df8-96d3-97cda9a16a66 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebdf8e3cd1b44dcba37cdcfb4af7db2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a8e1d26bdfc400ebd1e070b09db615e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:36:13.887840 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-8e7588f5-42e4-4df8-96d3-97cda9a16a66 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] 10.222.0.30 "GET /compute/v2.1/servers/f116c8d4-a63e-47e1-bb50-ec64f735bfcc" status: 200 len: 1723 microversion: 2.1 time: 0.289147 Jun 16 18:36:13.888662 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 363/763] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:36:13 2022] GET /compute/v2.1/servers/f116c8d4-a63e-47e1-bb50-ec64f735bfcc => generated 1723 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:36:14.915437 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-fc3432fc-ef87-4985-a4ec-db14b1caa8e1 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:36:14.917871 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-fc3432fc-ef87-4985-a4ec-db14b1caa8e1 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] [instance: f116c8d4-a63e-47e1-bb50-ec64f735bfcc] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:36:14.928788 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-fc3432fc-ef87-4985-a4ec-db14b1caa8e1 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:36:14.929544 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-fc3432fc-ef87-4985-a4ec-db14b1caa8e1 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:36:14.930541 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-fc3432fc-ef87-4985-a4ec-db14b1caa8e1 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:36:14.931309 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-fc3432fc-ef87-4985-a4ec-db14b1caa8e1 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:36:15.164744 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-fc3432fc-ef87-4985-a4ec-db14b1caa8e1 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebdf8e3cd1b44dcba37cdcfb4af7db2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a8e1d26bdfc400ebd1e070b09db615e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:36:15.182614 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-fc3432fc-ef87-4985-a4ec-db14b1caa8e1 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] 10.222.0.30 "GET /compute/v2.1/servers/f116c8d4-a63e-47e1-bb50-ec64f735bfcc" status: 200 len: 1723 microversion: 2.1 time: 0.274199 Jun 16 18:36:15.183808 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 401/764] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:36:14 2022] GET /compute/v2.1/servers/f116c8d4-a63e-47e1-bb50-ec64f735bfcc => generated 1723 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:36:16.207690 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-3bb6f735-e7c0-4797-aac6-b04395574dc4 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:36:16.208862 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-3bb6f735-e7c0-4797-aac6-b04395574dc4 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] [instance: f116c8d4-a63e-47e1-bb50-ec64f735bfcc] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:36:16.217151 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-3bb6f735-e7c0-4797-aac6-b04395574dc4 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:36:16.217870 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-3bb6f735-e7c0-4797-aac6-b04395574dc4 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:36:16.218936 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-3bb6f735-e7c0-4797-aac6-b04395574dc4 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:36:16.219725 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-3bb6f735-e7c0-4797-aac6-b04395574dc4 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:36:16.460331 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-3bb6f735-e7c0-4797-aac6-b04395574dc4 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebdf8e3cd1b44dcba37cdcfb4af7db2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a8e1d26bdfc400ebd1e070b09db615e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:36:16.470845 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-3bb6f735-e7c0-4797-aac6-b04395574dc4 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] 10.222.0.30 "GET /compute/v2.1/servers/f116c8d4-a63e-47e1-bb50-ec64f735bfcc" status: 200 len: 1723 microversion: 2.1 time: 0.269223 Jun 16 18:36:16.471594 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 364/765] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:36:16 2022] GET /compute/v2.1/servers/f116c8d4-a63e-47e1-bb50-ec64f735bfcc => generated 1723 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:36:17.494896 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-f266217e-80c3-4880-98f0-06f392f480ef tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:36:17.496486 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-f266217e-80c3-4880-98f0-06f392f480ef tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] [instance: f116c8d4-a63e-47e1-bb50-ec64f735bfcc] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:36:17.506661 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-f266217e-80c3-4880-98f0-06f392f480ef tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:36:17.507410 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-f266217e-80c3-4880-98f0-06f392f480ef tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:36:17.508825 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-f266217e-80c3-4880-98f0-06f392f480ef tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:36:17.509585 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-f266217e-80c3-4880-98f0-06f392f480ef tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:36:17.735728 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-f266217e-80c3-4880-98f0-06f392f480ef tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebdf8e3cd1b44dcba37cdcfb4af7db2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a8e1d26bdfc400ebd1e070b09db615e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:36:17.745899 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-f266217e-80c3-4880-98f0-06f392f480ef tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] 10.222.0.30 "GET /compute/v2.1/servers/f116c8d4-a63e-47e1-bb50-ec64f735bfcc" status: 200 len: 1723 microversion: 2.1 time: 0.256205 Jun 16 18:36:17.746514 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 402/766] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:36:17 2022] GET /compute/v2.1/servers/f116c8d4-a63e-47e1-bb50-ec64f735bfcc => generated 1723 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:36:18.774967 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-fdcb21c7-b21e-4360-82ed-cc569f746aa2 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:36:18.776104 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-fdcb21c7-b21e-4360-82ed-cc569f746aa2 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] [instance: f116c8d4-a63e-47e1-bb50-ec64f735bfcc] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:36:18.797511 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-fdcb21c7-b21e-4360-82ed-cc569f746aa2 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:36:18.799248 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-fdcb21c7-b21e-4360-82ed-cc569f746aa2 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:36:18.801559 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-fdcb21c7-b21e-4360-82ed-cc569f746aa2 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:36:18.802643 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-fdcb21c7-b21e-4360-82ed-cc569f746aa2 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:36:19.012591 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-fdcb21c7-b21e-4360-82ed-cc569f746aa2 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebdf8e3cd1b44dcba37cdcfb4af7db2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a8e1d26bdfc400ebd1e070b09db615e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:36:19.025180 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-fdcb21c7-b21e-4360-82ed-cc569f746aa2 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] 10.222.0.30 "GET /compute/v2.1/servers/f116c8d4-a63e-47e1-bb50-ec64f735bfcc" status: 200 len: 1700 microversion: 2.1 time: 0.258120 Jun 16 18:36:19.025989 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 365/767] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:36:18 2022] GET /compute/v2.1/servers/f116c8d4-a63e-47e1-bb50-ec64f735bfcc => generated 1700 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:36:19.044256 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-638ee146-1828-417e-b06a-cf1e5361624a tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:36:19.052115 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-638ee146-1828-417e-b06a-cf1e5361624a tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:36:19.052576 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-638ee146-1828-417e-b06a-cf1e5361624a tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:36:19.121554 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-638ee146-1828-417e-b06a-cf1e5361624a tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] [instance: f116c8d4-a63e-47e1-bb50-ec64f735bfcc] Going to try to start instance {{(pid=117670) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 16 18:36:19.179300 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-638ee146-1828-417e-b06a-cf1e5361624a tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] 10.222.0.30 "POST /compute/v2.1/servers/f116c8d4-a63e-47e1-bb50-ec64f735bfcc/action" status: 202 len: 0 microversion: 2.1 time: 0.139062 Jun 16 18:36:19.180305 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 403/768] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Jun 16 18:36:19 2022] POST /compute/v2.1/servers/f116c8d4-a63e-47e1-bb50-ec64f735bfcc/action => generated 0 bytes in 141 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 18:36:19.191766 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-927064f9-0799-479d-9b3a-57c7656dd64c tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:36:19.192681 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-927064f9-0799-479d-9b3a-57c7656dd64c tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] [instance: f116c8d4-a63e-47e1-bb50-ec64f735bfcc] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:36:19.200172 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-927064f9-0799-479d-9b3a-57c7656dd64c tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:36:19.200664 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-927064f9-0799-479d-9b3a-57c7656dd64c tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:36:19.201589 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-927064f9-0799-479d-9b3a-57c7656dd64c tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:36:19.202031 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-927064f9-0799-479d-9b3a-57c7656dd64c tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:36:19.391709 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-927064f9-0799-479d-9b3a-57c7656dd64c tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebdf8e3cd1b44dcba37cdcfb4af7db2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a8e1d26bdfc400ebd1e070b09db615e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:36:19.402742 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-927064f9-0799-479d-9b3a-57c7656dd64c tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] 10.222.0.30 "GET /compute/v2.1/servers/f116c8d4-a63e-47e1-bb50-ec64f735bfcc" status: 200 len: 1709 microversion: 2.1 time: 0.215014 Jun 16 18:36:19.403365 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 366/769] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:36:19 2022] GET /compute/v2.1/servers/f116c8d4-a63e-47e1-bb50-ec64f735bfcc => generated 1709 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:36:20.428553 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-8f2b1946-67fe-4204-ba99-f0682ce1d7b0 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:36:20.429567 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-8f2b1946-67fe-4204-ba99-f0682ce1d7b0 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] [instance: f116c8d4-a63e-47e1-bb50-ec64f735bfcc] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:36:20.437327 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-8f2b1946-67fe-4204-ba99-f0682ce1d7b0 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:36:20.437772 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-8f2b1946-67fe-4204-ba99-f0682ce1d7b0 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:36:20.438552 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-8f2b1946-67fe-4204-ba99-f0682ce1d7b0 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:36:20.438990 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-8f2b1946-67fe-4204-ba99-f0682ce1d7b0 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:36:20.606151 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-8f2b1946-67fe-4204-ba99-f0682ce1d7b0 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebdf8e3cd1b44dcba37cdcfb4af7db2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a8e1d26bdfc400ebd1e070b09db615e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:36:20.619208 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-8f2b1946-67fe-4204-ba99-f0682ce1d7b0 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] 10.222.0.30 "GET /compute/v2.1/servers/f116c8d4-a63e-47e1-bb50-ec64f735bfcc" status: 200 len: 1709 microversion: 2.1 time: 0.196161 Jun 16 18:36:20.620321 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 404/770] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:36:20 2022] GET /compute/v2.1/servers/f116c8d4-a63e-47e1-bb50-ec64f735bfcc => generated 1709 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:36:21.641753 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-068dc550-3299-43e7-bd37-efc49563afcf tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:36:21.642410 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-068dc550-3299-43e7-bd37-efc49563afcf tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] [instance: f116c8d4-a63e-47e1-bb50-ec64f735bfcc] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:36:21.646132 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG dbcounter [-] [117671] Writing DB stats nova_api:SELECT=29 {{(pid=117671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:21.652490 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-068dc550-3299-43e7-bd37-efc49563afcf tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:36:21.653108 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-068dc550-3299-43e7-bd37-efc49563afcf tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:36:21.653907 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-068dc550-3299-43e7-bd37-efc49563afcf tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:36:21.654341 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-068dc550-3299-43e7-bd37-efc49563afcf tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:36:21.657947 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG dbcounter [-] [117671] Writing DB stats nova_cell1:SELECT=86,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:22.143095 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-068dc550-3299-43e7-bd37-efc49563afcf tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebdf8e3cd1b44dcba37cdcfb4af7db2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a8e1d26bdfc400ebd1e070b09db615e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:36:22.152801 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-068dc550-3299-43e7-bd37-efc49563afcf tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] 10.222.0.30 "GET /compute/v2.1/servers/f116c8d4-a63e-47e1-bb50-ec64f735bfcc" status: 200 len: 1709 microversion: 2.1 time: 0.515529 Jun 16 18:36:22.153408 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 367/771] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:36:21 2022] GET /compute/v2.1/servers/f116c8d4-a63e-47e1-bb50-ec64f735bfcc => generated 1709 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:36:23.174248 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-75d2f5a9-39a6-466c-95ea-5b1397cf9120 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:36:23.174892 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-75d2f5a9-39a6-466c-95ea-5b1397cf9120 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] [instance: f116c8d4-a63e-47e1-bb50-ec64f735bfcc] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:36:23.185591 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-75d2f5a9-39a6-466c-95ea-5b1397cf9120 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:36:23.186571 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-75d2f5a9-39a6-466c-95ea-5b1397cf9120 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:36:23.187823 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-75d2f5a9-39a6-466c-95ea-5b1397cf9120 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:36:23.188600 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-75d2f5a9-39a6-466c-95ea-5b1397cf9120 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:36:23.391304 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-75d2f5a9-39a6-466c-95ea-5b1397cf9120 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebdf8e3cd1b44dcba37cdcfb4af7db2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a8e1d26bdfc400ebd1e070b09db615e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:36:23.400630 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-75d2f5a9-39a6-466c-95ea-5b1397cf9120 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] 10.222.0.30 "GET /compute/v2.1/servers/f116c8d4-a63e-47e1-bb50-ec64f735bfcc" status: 200 len: 1709 microversion: 2.1 time: 0.231310 Jun 16 18:36:23.401344 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 405/772] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:36:23 2022] GET /compute/v2.1/servers/f116c8d4-a63e-47e1-bb50-ec64f735bfcc => generated 1709 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:36:24.420004 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-34993ee0-9839-4423-bad2-aa8d7084d1bf tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:36:24.420838 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-34993ee0-9839-4423-bad2-aa8d7084d1bf tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] [instance: f116c8d4-a63e-47e1-bb50-ec64f735bfcc] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:36:24.429945 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-34993ee0-9839-4423-bad2-aa8d7084d1bf tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:36:24.430587 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-34993ee0-9839-4423-bad2-aa8d7084d1bf tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:36:24.431472 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-34993ee0-9839-4423-bad2-aa8d7084d1bf tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:36:24.431972 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-34993ee0-9839-4423-bad2-aa8d7084d1bf tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:36:24.618791 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-34993ee0-9839-4423-bad2-aa8d7084d1bf tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebdf8e3cd1b44dcba37cdcfb4af7db2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a8e1d26bdfc400ebd1e070b09db615e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:36:24.630842 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-34993ee0-9839-4423-bad2-aa8d7084d1bf tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] 10.222.0.30 "GET /compute/v2.1/servers/f116c8d4-a63e-47e1-bb50-ec64f735bfcc" status: 200 len: 1713 microversion: 2.1 time: 0.214538 Jun 16 18:36:24.631651 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 368/773] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:36:24 2022] GET /compute/v2.1/servers/f116c8d4-a63e-47e1-bb50-ec64f735bfcc => generated 1713 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:36:57.689431 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-b0beac14-8631-467d-8fd4-93d734d5043c tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:36:57.692082 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-b0beac14-8631-467d-8fd4-93d734d5043c tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] [instance: 858d3b02-c17d-4868-8adc-08e94d31c29c] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:36:57.701366 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG dbcounter [-] [117670] Writing DB stats nova_api:SELECT=12 {{(pid=117670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:57.702664 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG dbcounter [-] [117670] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:57.705874 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-b0beac14-8631-467d-8fd4-93d734d5043c tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:36:57.706396 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-b0beac14-8631-467d-8fd4-93d734d5043c tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:36:57.708291 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-b0beac14-8631-467d-8fd4-93d734d5043c tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:36:57.709054 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-b0beac14-8631-467d-8fd4-93d734d5043c tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:36:57.745820 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.objects.instance [None req-b0beac14-8631-467d-8fd4-93d734d5043c tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Lazy-loading 'flavor' on Instance uuid 858d3b02-c17d-4868-8adc-08e94d31c29c {{(pid=117670) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 18:36:57.877476 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-b0beac14-8631-467d-8fd4-93d734d5043c tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] 10.222.0.30 "POST /compute/v2.1/servers/858d3b02-c17d-4868-8adc-08e94d31c29c/action" status: 202 len: 0 microversion: 2.1 time: 0.195001 Jun 16 18:36:57.878360 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 406/774] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Jun 16 18:36:57 2022] POST /compute/v2.1/servers/858d3b02-c17d-4868-8adc-08e94d31c29c/action => generated 0 bytes in 197 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 18:36:57.895772 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-c18e5c90-4ceb-4c1a-9a09-47abf4dc0d01 tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:36:57.896966 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-c18e5c90-4ceb-4c1a-9a09-47abf4dc0d01 tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] [instance: 858d3b02-c17d-4868-8adc-08e94d31c29c] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:36:57.900623 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG dbcounter [-] [117671] Writing DB stats nova_api:SELECT=3 {{(pid=117671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:57.902728 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG dbcounter [-] [117671] Writing DB stats nova_cell1:SELECT=11 {{(pid=117671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:36:57.914934 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-c18e5c90-4ceb-4c1a-9a09-47abf4dc0d01 tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:36:57.915784 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-c18e5c90-4ceb-4c1a-9a09-47abf4dc0d01 tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:36:57.916751 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-c18e5c90-4ceb-4c1a-9a09-47abf4dc0d01 tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:36:57.917291 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-c18e5c90-4ceb-4c1a-9a09-47abf4dc0d01 tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:36:58.184726 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-c18e5c90-4ceb-4c1a-9a09-47abf4dc0d01 tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc31f4b39704173858410ae52ac2c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9f254f568e4bd98b2e4087c3a32c04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:36:58.196076 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-c18e5c90-4ceb-4c1a-9a09-47abf4dc0d01 tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] 10.222.0.30 "GET /compute/v2.1/servers/858d3b02-c17d-4868-8adc-08e94d31c29c" status: 200 len: 1568 microversion: 2.1 time: 0.309224 Jun 16 18:36:58.197240 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 369/775] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:36:57 2022] GET /compute/v2.1/servers/858d3b02-c17d-4868-8adc-08e94d31c29c => generated 1568 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:36:59.234870 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-db5584ca-d60b-4edc-86a5-dc3a0882aa85 tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:36:59.236193 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-db5584ca-d60b-4edc-86a5-dc3a0882aa85 tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] [instance: 858d3b02-c17d-4868-8adc-08e94d31c29c] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:36:59.247916 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-db5584ca-d60b-4edc-86a5-dc3a0882aa85 tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:36:59.248809 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-db5584ca-d60b-4edc-86a5-dc3a0882aa85 tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:36:59.249606 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-db5584ca-d60b-4edc-86a5-dc3a0882aa85 tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:36:59.250182 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-db5584ca-d60b-4edc-86a5-dc3a0882aa85 tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:36:59.493743 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-db5584ca-d60b-4edc-86a5-dc3a0882aa85 tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc31f4b39704173858410ae52ac2c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9f254f568e4bd98b2e4087c3a32c04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:36:59.522618 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-db5584ca-d60b-4edc-86a5-dc3a0882aa85 tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] 10.222.0.30 "GET /compute/v2.1/servers/858d3b02-c17d-4868-8adc-08e94d31c29c" status: 200 len: 1568 microversion: 2.1 time: 0.284372 Jun 16 18:36:59.523664 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 407/776] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:36:59 2022] GET /compute/v2.1/servers/858d3b02-c17d-4868-8adc-08e94d31c29c => generated 1568 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:37:00.556358 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-81611d86-07f1-4356-8cc8-5fcb04ed28e6 tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:37:00.557474 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-81611d86-07f1-4356-8cc8-5fcb04ed28e6 tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] [instance: 858d3b02-c17d-4868-8adc-08e94d31c29c] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:37:00.570299 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-81611d86-07f1-4356-8cc8-5fcb04ed28e6 tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:00.571488 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-81611d86-07f1-4356-8cc8-5fcb04ed28e6 tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:00.572947 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-81611d86-07f1-4356-8cc8-5fcb04ed28e6 tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:00.573727 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-81611d86-07f1-4356-8cc8-5fcb04ed28e6 tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:00.787204 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-81611d86-07f1-4356-8cc8-5fcb04ed28e6 tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc31f4b39704173858410ae52ac2c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9f254f568e4bd98b2e4087c3a32c04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:37:00.800542 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-81611d86-07f1-4356-8cc8-5fcb04ed28e6 tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] 10.222.0.30 "GET /compute/v2.1/servers/858d3b02-c17d-4868-8adc-08e94d31c29c" status: 200 len: 1568 microversion: 2.1 time: 0.251632 Jun 16 18:37:00.802020 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 370/777] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:37:00 2022] GET /compute/v2.1/servers/858d3b02-c17d-4868-8adc-08e94d31c29c => generated 1568 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:37:00.846506 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 16 18:37:00.847004 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: Thu Jun 16 18:37:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 16 18:37:01.827313 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-211c581b-85e1-475f-8336-8c7591bff131 tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:37:01.828237 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-211c581b-85e1-475f-8336-8c7591bff131 tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] [instance: 858d3b02-c17d-4868-8adc-08e94d31c29c] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:37:01.839680 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-211c581b-85e1-475f-8336-8c7591bff131 tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:01.840430 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-211c581b-85e1-475f-8336-8c7591bff131 tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:01.841676 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-211c581b-85e1-475f-8336-8c7591bff131 tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:01.842639 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-211c581b-85e1-475f-8336-8c7591bff131 tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:02.043418 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-211c581b-85e1-475f-8336-8c7591bff131 tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc31f4b39704173858410ae52ac2c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9f254f568e4bd98b2e4087c3a32c04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:37:02.061667 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-211c581b-85e1-475f-8336-8c7591bff131 tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] 10.222.0.30 "GET /compute/v2.1/servers/858d3b02-c17d-4868-8adc-08e94d31c29c" status: 200 len: 1568 microversion: 2.1 time: 0.242003 Jun 16 18:37:02.062833 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 408/778] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:37:01 2022] GET /compute/v2.1/servers/858d3b02-c17d-4868-8adc-08e94d31c29c => generated 1568 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:37:03.080643 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-e761d2b1-3c0c-4bef-97f7-f9d80b1f39a2 tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:37:03.083140 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-e761d2b1-3c0c-4bef-97f7-f9d80b1f39a2 tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] [instance: 858d3b02-c17d-4868-8adc-08e94d31c29c] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:37:03.091663 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-e761d2b1-3c0c-4bef-97f7-f9d80b1f39a2 tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:03.092765 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-e761d2b1-3c0c-4bef-97f7-f9d80b1f39a2 tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:03.094048 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-e761d2b1-3c0c-4bef-97f7-f9d80b1f39a2 tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:03.094846 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-e761d2b1-3c0c-4bef-97f7-f9d80b1f39a2 tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:03.310992 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-e761d2b1-3c0c-4bef-97f7-f9d80b1f39a2 tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc31f4b39704173858410ae52ac2c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9f254f568e4bd98b2e4087c3a32c04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:37:03.322203 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-e761d2b1-3c0c-4bef-97f7-f9d80b1f39a2 tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] 10.222.0.30 "GET /compute/v2.1/servers/858d3b02-c17d-4868-8adc-08e94d31c29c" status: 200 len: 1568 microversion: 2.1 time: 0.246277 Jun 16 18:37:03.323018 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 371/779] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:37:03 2022] GET /compute/v2.1/servers/858d3b02-c17d-4868-8adc-08e94d31c29c => generated 1568 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:37:04.340908 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-45aabdcd-8d4d-46d6-9d8b-216204963e50 tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:37:04.341775 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-45aabdcd-8d4d-46d6-9d8b-216204963e50 tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] [instance: 858d3b02-c17d-4868-8adc-08e94d31c29c] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:37:04.354475 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-45aabdcd-8d4d-46d6-9d8b-216204963e50 tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:04.355255 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-45aabdcd-8d4d-46d6-9d8b-216204963e50 tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:04.356705 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-45aabdcd-8d4d-46d6-9d8b-216204963e50 tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:04.357493 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-45aabdcd-8d4d-46d6-9d8b-216204963e50 tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:04.581055 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-45aabdcd-8d4d-46d6-9d8b-216204963e50 tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc31f4b39704173858410ae52ac2c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9f254f568e4bd98b2e4087c3a32c04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:37:04.596452 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-45aabdcd-8d4d-46d6-9d8b-216204963e50 tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] 10.222.0.30 "GET /compute/v2.1/servers/858d3b02-c17d-4868-8adc-08e94d31c29c" status: 200 len: 1568 microversion: 2.1 time: 0.259275 Jun 16 18:37:04.597991 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 409/780] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:37:04 2022] GET /compute/v2.1/servers/858d3b02-c17d-4868-8adc-08e94d31c29c => generated 1568 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:37:05.621071 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-98251412-e5dd-42a6-82bc-162756856b4d tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:37:05.622149 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-98251412-e5dd-42a6-82bc-162756856b4d tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] [instance: 858d3b02-c17d-4868-8adc-08e94d31c29c] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:37:05.630906 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-98251412-e5dd-42a6-82bc-162756856b4d tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:05.631414 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-98251412-e5dd-42a6-82bc-162756856b4d tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:05.632259 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-98251412-e5dd-42a6-82bc-162756856b4d tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:05.632858 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-98251412-e5dd-42a6-82bc-162756856b4d tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:05.817920 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-98251412-e5dd-42a6-82bc-162756856b4d tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc31f4b39704173858410ae52ac2c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9f254f568e4bd98b2e4087c3a32c04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:37:05.828094 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-98251412-e5dd-42a6-82bc-162756856b4d tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] 10.222.0.30 "GET /compute/v2.1/servers/858d3b02-c17d-4868-8adc-08e94d31c29c" status: 200 len: 1568 microversion: 2.1 time: 0.211265 Jun 16 18:37:05.828916 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 372/781] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:37:05 2022] GET /compute/v2.1/servers/858d3b02-c17d-4868-8adc-08e94d31c29c => generated 1568 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:37:06.122786 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-cd34f1f0-be8c-499f-b200-93281176ca21 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:37:06.123665 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-cd34f1f0-be8c-499f-b200-93281176ca21 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] [instance: f116c8d4-a63e-47e1-bb50-ec64f735bfcc] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:37:06.135559 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-cd34f1f0-be8c-499f-b200-93281176ca21 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:06.136466 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-cd34f1f0-be8c-499f-b200-93281176ca21 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:06.137800 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-cd34f1f0-be8c-499f-b200-93281176ca21 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:06.138600 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-cd34f1f0-be8c-499f-b200-93281176ca21 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:06.261253 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.objects.instance [None req-cd34f1f0-be8c-499f-b200-93281176ca21 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lazy-loading 'services' on Instance uuid f116c8d4-a63e-47e1-bb50-ec64f735bfcc {{(pid=117670) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 18:37:06.359782 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-cd34f1f0-be8c-499f-b200-93281176ca21 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] 10.222.0.30 "DELETE /compute/v2.1/servers/f116c8d4-a63e-47e1-bb50-ec64f735bfcc/os-volume_attachments/8be68778-6f90-404c-8b9b-24d9ee261f1d" status: 202 len: 0 microversion: 2.1 time: 0.243772 Jun 16 18:37:06.360696 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 410/782] 10.222.0.30 () {58 vars in 1415 bytes} [Thu Jun 16 18:37:06 2022] DELETE /compute/v2.1/servers/f116c8d4-a63e-47e1-bb50-ec64f735bfcc/os-volume_attachments/8be68778-6f90-404c-8b9b-24d9ee261f1d => generated 0 bytes in 246 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 18:37:06.851885 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-c714a0cc-e0f0-4368-bfdb-f312d4d060bf tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:37:06.853087 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-c714a0cc-e0f0-4368-bfdb-f312d4d060bf tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] [instance: 858d3b02-c17d-4868-8adc-08e94d31c29c] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:37:06.866264 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-c714a0cc-e0f0-4368-bfdb-f312d4d060bf tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:06.867063 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-c714a0cc-e0f0-4368-bfdb-f312d4d060bf tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:06.868627 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-c714a0cc-e0f0-4368-bfdb-f312d4d060bf tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:06.869504 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-c714a0cc-e0f0-4368-bfdb-f312d4d060bf tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:07.096760 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-c714a0cc-e0f0-4368-bfdb-f312d4d060bf tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc31f4b39704173858410ae52ac2c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9f254f568e4bd98b2e4087c3a32c04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:37:07.110367 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-c714a0cc-e0f0-4368-bfdb-f312d4d060bf tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] 10.222.0.30 "GET /compute/v2.1/servers/858d3b02-c17d-4868-8adc-08e94d31c29c" status: 200 len: 1568 microversion: 2.1 time: 0.267110 Jun 16 18:37:07.111824 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 373/783] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:37:06 2022] GET /compute/v2.1/servers/858d3b02-c17d-4868-8adc-08e94d31c29c => generated 1568 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:37:07.531165 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-61e624c1-4cdc-4196-b691-43b38c66a968 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:37:07.541669 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-61e624c1-4cdc-4196-b691-43b38c66a968 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:07.542281 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-61e624c1-4cdc-4196-b691-43b38c66a968 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:07.579768 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-61e624c1-4cdc-4196-b691-43b38c66a968 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] [instance: f116c8d4-a63e-47e1-bb50-ec64f735bfcc] Going to try to stop instance {{(pid=117670) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 16 18:37:07.659787 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-61e624c1-4cdc-4196-b691-43b38c66a968 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] 10.222.0.30 "POST /compute/v2.1/servers/f116c8d4-a63e-47e1-bb50-ec64f735bfcc/action" status: 202 len: 0 microversion: 2.1 time: 0.135324 Jun 16 18:37:07.660702 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 411/784] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Jun 16 18:37:07 2022] POST /compute/v2.1/servers/f116c8d4-a63e-47e1-bb50-ec64f735bfcc/action => generated 0 bytes in 140 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 18:37:07.677871 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-ff45c8bb-ca3b-4d55-a24e-58fa35614711 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:37:07.678970 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-ff45c8bb-ca3b-4d55-a24e-58fa35614711 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] [instance: f116c8d4-a63e-47e1-bb50-ec64f735bfcc] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:37:07.690291 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-ff45c8bb-ca3b-4d55-a24e-58fa35614711 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:07.692027 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-ff45c8bb-ca3b-4d55-a24e-58fa35614711 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:07.693229 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-ff45c8bb-ca3b-4d55-a24e-58fa35614711 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:07.693671 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-ff45c8bb-ca3b-4d55-a24e-58fa35614711 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:07.926844 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-ff45c8bb-ca3b-4d55-a24e-58fa35614711 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebdf8e3cd1b44dcba37cdcfb4af7db2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a8e1d26bdfc400ebd1e070b09db615e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:37:07.939069 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-ff45c8bb-ca3b-4d55-a24e-58fa35614711 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] 10.222.0.30 "GET /compute/v2.1/servers/f116c8d4-a63e-47e1-bb50-ec64f735bfcc" status: 200 len: 1677 microversion: 2.1 time: 0.269209 Jun 16 18:37:07.939933 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 374/785] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:37:07 2022] GET /compute/v2.1/servers/f116c8d4-a63e-47e1-bb50-ec64f735bfcc => generated 1677 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:37:08.139149 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-02dfaa6a-5e0e-4350-b576-79e6a937f5be tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:37:08.139941 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-02dfaa6a-5e0e-4350-b576-79e6a937f5be tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] [instance: 858d3b02-c17d-4868-8adc-08e94d31c29c] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:37:08.148008 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-02dfaa6a-5e0e-4350-b576-79e6a937f5be tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:08.148504 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-02dfaa6a-5e0e-4350-b576-79e6a937f5be tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:08.149299 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-02dfaa6a-5e0e-4350-b576-79e6a937f5be tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:08.149739 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-02dfaa6a-5e0e-4350-b576-79e6a937f5be tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:08.310555 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-02dfaa6a-5e0e-4350-b576-79e6a937f5be tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc31f4b39704173858410ae52ac2c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9f254f568e4bd98b2e4087c3a32c04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:37:08.319469 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-02dfaa6a-5e0e-4350-b576-79e6a937f5be tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] 10.222.0.30 "GET /compute/v2.1/servers/858d3b02-c17d-4868-8adc-08e94d31c29c" status: 200 len: 1568 microversion: 2.1 time: 0.185413 Jun 16 18:37:08.320118 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 412/786] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:37:08 2022] GET /compute/v2.1/servers/858d3b02-c17d-4868-8adc-08e94d31c29c => generated 1568 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:37:08.967705 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-7b83e57f-e592-44a0-a034-d1bdaf678200 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:37:08.968825 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-7b83e57f-e592-44a0-a034-d1bdaf678200 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] [instance: f116c8d4-a63e-47e1-bb50-ec64f735bfcc] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:37:08.976997 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-7b83e57f-e592-44a0-a034-d1bdaf678200 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:08.977932 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-7b83e57f-e592-44a0-a034-d1bdaf678200 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:08.978944 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-7b83e57f-e592-44a0-a034-d1bdaf678200 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:08.979692 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-7b83e57f-e592-44a0-a034-d1bdaf678200 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:09.201195 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-7b83e57f-e592-44a0-a034-d1bdaf678200 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebdf8e3cd1b44dcba37cdcfb4af7db2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a8e1d26bdfc400ebd1e070b09db615e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:37:09.211840 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-7b83e57f-e592-44a0-a034-d1bdaf678200 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] 10.222.0.30 "GET /compute/v2.1/servers/f116c8d4-a63e-47e1-bb50-ec64f735bfcc" status: 200 len: 1677 microversion: 2.1 time: 0.248485 Jun 16 18:37:09.212375 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 375/787] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:37:08 2022] GET /compute/v2.1/servers/f116c8d4-a63e-47e1-bb50-ec64f735bfcc => generated 1677 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:37:09.339426 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-a0025d04-a4b6-4b1b-a254-1ad47837a236 tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:37:09.341048 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-a0025d04-a4b6-4b1b-a254-1ad47837a236 tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] [instance: 858d3b02-c17d-4868-8adc-08e94d31c29c] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:37:09.353407 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-a0025d04-a4b6-4b1b-a254-1ad47837a236 tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:09.354554 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-a0025d04-a4b6-4b1b-a254-1ad47837a236 tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:09.356547 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-a0025d04-a4b6-4b1b-a254-1ad47837a236 tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:09.357404 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-a0025d04-a4b6-4b1b-a254-1ad47837a236 tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:09.573365 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-a0025d04-a4b6-4b1b-a254-1ad47837a236 tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc31f4b39704173858410ae52ac2c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9f254f568e4bd98b2e4087c3a32c04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:37:09.582074 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-a0025d04-a4b6-4b1b-a254-1ad47837a236 tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] 10.222.0.30 "GET /compute/v2.1/servers/858d3b02-c17d-4868-8adc-08e94d31c29c" status: 200 len: 1568 microversion: 2.1 time: 0.247406 Jun 16 18:37:09.582672 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 413/788] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:37:09 2022] GET /compute/v2.1/servers/858d3b02-c17d-4868-8adc-08e94d31c29c => generated 1568 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:37:10.229954 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-4313ceab-59e6-4029-8fb8-00c5179099fa tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:37:10.230552 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-4313ceab-59e6-4029-8fb8-00c5179099fa tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] [instance: f116c8d4-a63e-47e1-bb50-ec64f735bfcc] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:37:10.238465 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-4313ceab-59e6-4029-8fb8-00c5179099fa tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:10.239061 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-4313ceab-59e6-4029-8fb8-00c5179099fa tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:10.239972 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-4313ceab-59e6-4029-8fb8-00c5179099fa tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:10.240463 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-4313ceab-59e6-4029-8fb8-00c5179099fa tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:10.602734 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-bffd3dc7-1edf-46a7-8bd5-485e6f7a0552 tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:37:10.603952 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-bffd3dc7-1edf-46a7-8bd5-485e6f7a0552 tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] [instance: 858d3b02-c17d-4868-8adc-08e94d31c29c] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:37:10.614865 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-bffd3dc7-1edf-46a7-8bd5-485e6f7a0552 tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:10.615531 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-bffd3dc7-1edf-46a7-8bd5-485e6f7a0552 tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:10.616539 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-bffd3dc7-1edf-46a7-8bd5-485e6f7a0552 tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:10.617087 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-bffd3dc7-1edf-46a7-8bd5-485e6f7a0552 tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:10.636410 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-4313ceab-59e6-4029-8fb8-00c5179099fa tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebdf8e3cd1b44dcba37cdcfb4af7db2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a8e1d26bdfc400ebd1e070b09db615e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:37:10.657557 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-4313ceab-59e6-4029-8fb8-00c5179099fa tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] 10.222.0.30 "GET /compute/v2.1/servers/f116c8d4-a63e-47e1-bb50-ec64f735bfcc" status: 200 len: 1677 microversion: 2.1 time: 0.431202 Jun 16 18:37:10.662134 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 376/789] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:37:10 2022] GET /compute/v2.1/servers/f116c8d4-a63e-47e1-bb50-ec64f735bfcc => generated 1677 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:37:10.859235 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-bffd3dc7-1edf-46a7-8bd5-485e6f7a0552 tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc31f4b39704173858410ae52ac2c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9f254f568e4bd98b2e4087c3a32c04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:37:10.870585 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-bffd3dc7-1edf-46a7-8bd5-485e6f7a0552 tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] 10.222.0.30 "GET /compute/v2.1/servers/858d3b02-c17d-4868-8adc-08e94d31c29c" status: 200 len: 1568 microversion: 2.1 time: 0.274470 Jun 16 18:37:10.871386 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 414/790] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:37:10 2022] GET /compute/v2.1/servers/858d3b02-c17d-4868-8adc-08e94d31c29c => generated 1568 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:37:11.246888 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 16 18:37:11.247172 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: Thu Jun 16 18:37:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 16 18:37:11.685539 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-a4e1d23e-46d7-4022-aa22-5fb3874ff0fd tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:37:11.686189 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-a4e1d23e-46d7-4022-aa22-5fb3874ff0fd tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] [instance: f116c8d4-a63e-47e1-bb50-ec64f735bfcc] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:37:11.694216 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-a4e1d23e-46d7-4022-aa22-5fb3874ff0fd tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:11.694667 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-a4e1d23e-46d7-4022-aa22-5fb3874ff0fd tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:11.695491 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-a4e1d23e-46d7-4022-aa22-5fb3874ff0fd tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:11.695965 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-a4e1d23e-46d7-4022-aa22-5fb3874ff0fd tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:11.888347 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-a4e1d23e-46d7-4022-aa22-5fb3874ff0fd tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebdf8e3cd1b44dcba37cdcfb4af7db2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a8e1d26bdfc400ebd1e070b09db615e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:37:11.894292 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-50bdf40a-ceda-47ea-adc1-6e2cc983c1a5 tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:37:11.895423 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-50bdf40a-ceda-47ea-adc1-6e2cc983c1a5 tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] [instance: 858d3b02-c17d-4868-8adc-08e94d31c29c] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:37:11.902284 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-a4e1d23e-46d7-4022-aa22-5fb3874ff0fd tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] 10.222.0.30 "GET /compute/v2.1/servers/f116c8d4-a63e-47e1-bb50-ec64f735bfcc" status: 200 len: 1677 microversion: 2.1 time: 0.220633 Jun 16 18:37:11.903215 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 377/791] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:37:11 2022] GET /compute/v2.1/servers/f116c8d4-a63e-47e1-bb50-ec64f735bfcc => generated 1677 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:37:11.906862 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-50bdf40a-ceda-47ea-adc1-6e2cc983c1a5 tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:11.907647 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-50bdf40a-ceda-47ea-adc1-6e2cc983c1a5 tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:11.909094 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-50bdf40a-ceda-47ea-adc1-6e2cc983c1a5 tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:11.909886 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-50bdf40a-ceda-47ea-adc1-6e2cc983c1a5 tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:12.105139 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-50bdf40a-ceda-47ea-adc1-6e2cc983c1a5 tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc31f4b39704173858410ae52ac2c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9f254f568e4bd98b2e4087c3a32c04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:37:12.114622 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-50bdf40a-ceda-47ea-adc1-6e2cc983c1a5 tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] 10.222.0.30 "GET /compute/v2.1/servers/858d3b02-c17d-4868-8adc-08e94d31c29c" status: 200 len: 1568 microversion: 2.1 time: 0.227627 Jun 16 18:37:12.115239 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 415/792] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:37:11 2022] GET /compute/v2.1/servers/858d3b02-c17d-4868-8adc-08e94d31c29c => generated 1568 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:37:12.932476 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-726953a8-da7f-4201-9560-1cda990c015e tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:37:12.933281 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-726953a8-da7f-4201-9560-1cda990c015e tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] [instance: f116c8d4-a63e-47e1-bb50-ec64f735bfcc] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:37:12.944232 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-726953a8-da7f-4201-9560-1cda990c015e tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:12.944719 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-726953a8-da7f-4201-9560-1cda990c015e tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:12.945692 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-726953a8-da7f-4201-9560-1cda990c015e tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:12.946147 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-726953a8-da7f-4201-9560-1cda990c015e tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:13.134287 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-af7fc882-57d8-4296-bfb0-fa1180b49040 tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:37:13.135082 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-af7fc882-57d8-4296-bfb0-fa1180b49040 tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] [instance: 858d3b02-c17d-4868-8adc-08e94d31c29c] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:37:13.143290 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-af7fc882-57d8-4296-bfb0-fa1180b49040 tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:13.144467 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-af7fc882-57d8-4296-bfb0-fa1180b49040 tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:13.145417 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-af7fc882-57d8-4296-bfb0-fa1180b49040 tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:13.145862 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-af7fc882-57d8-4296-bfb0-fa1180b49040 tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:13.269439 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-726953a8-da7f-4201-9560-1cda990c015e tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebdf8e3cd1b44dcba37cdcfb4af7db2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a8e1d26bdfc400ebd1e070b09db615e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:37:13.285921 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-726953a8-da7f-4201-9560-1cda990c015e tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] 10.222.0.30 "GET /compute/v2.1/servers/f116c8d4-a63e-47e1-bb50-ec64f735bfcc" status: 200 len: 1677 microversion: 2.1 time: 0.361541 Jun 16 18:37:13.287241 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 378/793] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:37:12 2022] GET /compute/v2.1/servers/f116c8d4-a63e-47e1-bb50-ec64f735bfcc => generated 1677 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:37:13.464238 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-af7fc882-57d8-4296-bfb0-fa1180b49040 tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc31f4b39704173858410ae52ac2c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9f254f568e4bd98b2e4087c3a32c04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:37:13.474062 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-af7fc882-57d8-4296-bfb0-fa1180b49040 tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] 10.222.0.30 "GET /compute/v2.1/servers/858d3b02-c17d-4868-8adc-08e94d31c29c" status: 200 len: 1568 microversion: 2.1 time: 0.344493 Jun 16 18:37:13.474960 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 416/794] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:37:13 2022] GET /compute/v2.1/servers/858d3b02-c17d-4868-8adc-08e94d31c29c => generated 1568 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:37:14.307118 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-a9efad9c-74b3-4005-b1ac-8728a3e91615 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:37:14.308224 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-a9efad9c-74b3-4005-b1ac-8728a3e91615 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] [instance: f116c8d4-a63e-47e1-bb50-ec64f735bfcc] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:37:14.314493 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-a9efad9c-74b3-4005-b1ac-8728a3e91615 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:14.314952 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-a9efad9c-74b3-4005-b1ac-8728a3e91615 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:14.315793 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-a9efad9c-74b3-4005-b1ac-8728a3e91615 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:14.316273 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-a9efad9c-74b3-4005-b1ac-8728a3e91615 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:14.475711 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-a9efad9c-74b3-4005-b1ac-8728a3e91615 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebdf8e3cd1b44dcba37cdcfb4af7db2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a8e1d26bdfc400ebd1e070b09db615e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:37:14.485499 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-a9efad9c-74b3-4005-b1ac-8728a3e91615 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] 10.222.0.30 "GET /compute/v2.1/servers/f116c8d4-a63e-47e1-bb50-ec64f735bfcc" status: 200 len: 1677 microversion: 2.1 time: 0.182550 Jun 16 18:37:14.486074 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 379/795] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:37:14 2022] GET /compute/v2.1/servers/f116c8d4-a63e-47e1-bb50-ec64f735bfcc => generated 1677 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:37:14.495843 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-05dd7c9c-a985-4db0-ba6a-c463eac7fbf4 tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:37:14.496830 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-05dd7c9c-a985-4db0-ba6a-c463eac7fbf4 tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] [instance: 858d3b02-c17d-4868-8adc-08e94d31c29c] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:37:14.506130 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-05dd7c9c-a985-4db0-ba6a-c463eac7fbf4 tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:14.506581 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-05dd7c9c-a985-4db0-ba6a-c463eac7fbf4 tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:14.507448 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-05dd7c9c-a985-4db0-ba6a-c463eac7fbf4 tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:14.509888 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-05dd7c9c-a985-4db0-ba6a-c463eac7fbf4 tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:14.697663 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-05dd7c9c-a985-4db0-ba6a-c463eac7fbf4 tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc31f4b39704173858410ae52ac2c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9f254f568e4bd98b2e4087c3a32c04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:37:14.708315 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-05dd7c9c-a985-4db0-ba6a-c463eac7fbf4 tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] 10.222.0.30 "GET /compute/v2.1/servers/858d3b02-c17d-4868-8adc-08e94d31c29c" status: 200 len: 1568 microversion: 2.1 time: 0.216908 Jun 16 18:37:14.709299 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 417/796] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:37:14 2022] GET /compute/v2.1/servers/858d3b02-c17d-4868-8adc-08e94d31c29c => generated 1568 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:37:15.512503 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-4d4b65df-437d-4e2c-b56a-dd1022e24793 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:37:15.514752 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-4d4b65df-437d-4e2c-b56a-dd1022e24793 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] [instance: f116c8d4-a63e-47e1-bb50-ec64f735bfcc] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:37:15.523057 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-4d4b65df-437d-4e2c-b56a-dd1022e24793 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:15.523500 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-4d4b65df-437d-4e2c-b56a-dd1022e24793 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:15.524357 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-4d4b65df-437d-4e2c-b56a-dd1022e24793 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:15.524974 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-4d4b65df-437d-4e2c-b56a-dd1022e24793 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:15.705314 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-4d4b65df-437d-4e2c-b56a-dd1022e24793 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebdf8e3cd1b44dcba37cdcfb4af7db2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a8e1d26bdfc400ebd1e070b09db615e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:37:15.716398 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-4d4b65df-437d-4e2c-b56a-dd1022e24793 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] 10.222.0.30 "GET /compute/v2.1/servers/f116c8d4-a63e-47e1-bb50-ec64f735bfcc" status: 200 len: 1677 microversion: 2.1 time: 0.208294 Jun 16 18:37:15.717029 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 380/797] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:37:15 2022] GET /compute/v2.1/servers/f116c8d4-a63e-47e1-bb50-ec64f735bfcc => generated 1677 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:37:15.729195 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-9c79e1ba-1454-4a2d-bc2d-63cef5bd11e4 tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:37:15.730546 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-9c79e1ba-1454-4a2d-bc2d-63cef5bd11e4 tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] [instance: 858d3b02-c17d-4868-8adc-08e94d31c29c] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:37:15.741880 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-9c79e1ba-1454-4a2d-bc2d-63cef5bd11e4 tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:15.742691 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-9c79e1ba-1454-4a2d-bc2d-63cef5bd11e4 tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:15.744120 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-9c79e1ba-1454-4a2d-bc2d-63cef5bd11e4 tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:15.744953 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-9c79e1ba-1454-4a2d-bc2d-63cef5bd11e4 tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:16.000607 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-9c79e1ba-1454-4a2d-bc2d-63cef5bd11e4 tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc31f4b39704173858410ae52ac2c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9f254f568e4bd98b2e4087c3a32c04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:37:16.010467 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG dbcounter [-] [117670] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=117670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:16.023348 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-9c79e1ba-1454-4a2d-bc2d-63cef5bd11e4 tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] 10.222.0.30 "GET /compute/v2.1/servers/858d3b02-c17d-4868-8adc-08e94d31c29c" status: 200 len: 1568 microversion: 2.1 time: 0.299199 Jun 16 18:37:16.025201 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 418/798] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:37:15 2022] GET /compute/v2.1/servers/858d3b02-c17d-4868-8adc-08e94d31c29c => generated 1568 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:37:16.737933 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-05d75a3a-2f18-4f60-9b98-51e518a07d54 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:37:16.739236 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-05d75a3a-2f18-4f60-9b98-51e518a07d54 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] [instance: f116c8d4-a63e-47e1-bb50-ec64f735bfcc] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:37:16.745747 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-05d75a3a-2f18-4f60-9b98-51e518a07d54 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:16.746210 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-05d75a3a-2f18-4f60-9b98-51e518a07d54 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:16.747013 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-05d75a3a-2f18-4f60-9b98-51e518a07d54 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:16.747459 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-05d75a3a-2f18-4f60-9b98-51e518a07d54 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:17.022241 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-05d75a3a-2f18-4f60-9b98-51e518a07d54 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebdf8e3cd1b44dcba37cdcfb4af7db2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a8e1d26bdfc400ebd1e070b09db615e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:37:17.033596 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-05d75a3a-2f18-4f60-9b98-51e518a07d54 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] 10.222.0.30 "GET /compute/v2.1/servers/f116c8d4-a63e-47e1-bb50-ec64f735bfcc" status: 200 len: 1677 microversion: 2.1 time: 0.300037 Jun 16 18:37:17.034927 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 381/799] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:37:16 2022] GET /compute/v2.1/servers/f116c8d4-a63e-47e1-bb50-ec64f735bfcc => generated 1677 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:37:17.052986 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-5777ecda-5805-456d-a0ea-e87b9c88a6f9 tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:37:17.054142 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-5777ecda-5805-456d-a0ea-e87b9c88a6f9 tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] [instance: 858d3b02-c17d-4868-8adc-08e94d31c29c] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:37:17.067386 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-5777ecda-5805-456d-a0ea-e87b9c88a6f9 tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:17.068081 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-5777ecda-5805-456d-a0ea-e87b9c88a6f9 tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:17.069688 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-5777ecda-5805-456d-a0ea-e87b9c88a6f9 tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:17.070452 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-5777ecda-5805-456d-a0ea-e87b9c88a6f9 tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:17.309101 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-5777ecda-5805-456d-a0ea-e87b9c88a6f9 tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc31f4b39704173858410ae52ac2c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9f254f568e4bd98b2e4087c3a32c04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:37:17.328558 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-5777ecda-5805-456d-a0ea-e87b9c88a6f9 tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] 10.222.0.30 "GET /compute/v2.1/servers/858d3b02-c17d-4868-8adc-08e94d31c29c" status: 200 len: 1509 microversion: 2.1 time: 0.282953 Jun 16 18:37:17.338006 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 419/800] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:37:17 2022] GET /compute/v2.1/servers/858d3b02-c17d-4868-8adc-08e94d31c29c => generated 1509 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:37:17.352931 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-1b9a6c02-1da5-45f1-922b-475cebd222db tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:37:17.354457 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-1b9a6c02-1da5-45f1-922b-475cebd222db tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] [instance: 858d3b02-c17d-4868-8adc-08e94d31c29c] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:37:17.367511 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-1b9a6c02-1da5-45f1-922b-475cebd222db tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:17.369443 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-1b9a6c02-1da5-45f1-922b-475cebd222db tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:17.371027 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-1b9a6c02-1da5-45f1-922b-475cebd222db tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:17.371968 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-1b9a6c02-1da5-45f1-922b-475cebd222db tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:17.598298 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-1b9a6c02-1da5-45f1-922b-475cebd222db tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] 10.222.0.30 "POST /compute/v2.1/servers/858d3b02-c17d-4868-8adc-08e94d31c29c/action" status: 202 len: 0 microversion: 2.1 time: 0.254367 Jun 16 18:37:17.604479 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 382/801] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Jun 16 18:37:17 2022] POST /compute/v2.1/servers/858d3b02-c17d-4868-8adc-08e94d31c29c/action => generated 0 bytes in 262 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 18:37:17.615949 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-b21f0a85-fc0f-4642-8708-875269ba7e16 tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:37:17.617646 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-b21f0a85-fc0f-4642-8708-875269ba7e16 tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] [instance: 858d3b02-c17d-4868-8adc-08e94d31c29c] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:37:17.631942 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-b21f0a85-fc0f-4642-8708-875269ba7e16 tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:17.633133 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-b21f0a85-fc0f-4642-8708-875269ba7e16 tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:17.634763 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-b21f0a85-fc0f-4642-8708-875269ba7e16 tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:17.635664 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-b21f0a85-fc0f-4642-8708-875269ba7e16 tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:17.881309 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-b21f0a85-fc0f-4642-8708-875269ba7e16 tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc31f4b39704173858410ae52ac2c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9f254f568e4bd98b2e4087c3a32c04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:37:17.891535 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-b21f0a85-fc0f-4642-8708-875269ba7e16 tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] 10.222.0.30 "GET /compute/v2.1/servers/858d3b02-c17d-4868-8adc-08e94d31c29c" status: 200 len: 1517 microversion: 2.1 time: 0.285240 Jun 16 18:37:17.892241 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 420/802] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:37:17 2022] GET /compute/v2.1/servers/858d3b02-c17d-4868-8adc-08e94d31c29c => generated 1517 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:37:18.059075 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-a26be8bf-083e-467a-8264-3741feedea85 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:37:18.061790 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-a26be8bf-083e-467a-8264-3741feedea85 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] [instance: f116c8d4-a63e-47e1-bb50-ec64f735bfcc] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:37:18.075044 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-a26be8bf-083e-467a-8264-3741feedea85 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:18.075753 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-a26be8bf-083e-467a-8264-3741feedea85 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:18.077008 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-a26be8bf-083e-467a-8264-3741feedea85 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:18.077621 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-a26be8bf-083e-467a-8264-3741feedea85 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:18.412692 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-a26be8bf-083e-467a-8264-3741feedea85 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebdf8e3cd1b44dcba37cdcfb4af7db2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a8e1d26bdfc400ebd1e070b09db615e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:37:18.425868 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-a26be8bf-083e-467a-8264-3741feedea85 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] 10.222.0.30 "GET /compute/v2.1/servers/f116c8d4-a63e-47e1-bb50-ec64f735bfcc" status: 200 len: 1654 microversion: 2.1 time: 0.374894 Jun 16 18:37:18.426927 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 383/803] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:37:18 2022] GET /compute/v2.1/servers/f116c8d4-a63e-47e1-bb50-ec64f735bfcc => generated 1654 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:37:18.453812 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-0e6cce5e-68ed-4edc-8aeb-ea0c72d6f27a tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:37:18.464551 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-0e6cce5e-68ed-4edc-8aeb-ea0c72d6f27a tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:18.465122 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-0e6cce5e-68ed-4edc-8aeb-ea0c72d6f27a tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:18.492005 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-0e6cce5e-68ed-4edc-8aeb-ea0c72d6f27a tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] [instance: f116c8d4-a63e-47e1-bb50-ec64f735bfcc] Going to try to start instance {{(pid=117670) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 16 18:37:18.558061 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-0e6cce5e-68ed-4edc-8aeb-ea0c72d6f27a tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] 10.222.0.30 "POST /compute/v2.1/servers/f116c8d4-a63e-47e1-bb50-ec64f735bfcc/action" status: 202 len: 0 microversion: 2.1 time: 0.112755 Jun 16 18:37:18.559041 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 421/804] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Jun 16 18:37:18 2022] POST /compute/v2.1/servers/f116c8d4-a63e-47e1-bb50-ec64f735bfcc/action => generated 0 bytes in 116 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 18:37:18.570206 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-df394558-7a1d-45cd-b558-2626cca476ea tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:37:18.571861 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-df394558-7a1d-45cd-b558-2626cca476ea tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] [instance: f116c8d4-a63e-47e1-bb50-ec64f735bfcc] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:37:18.583203 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-df394558-7a1d-45cd-b558-2626cca476ea tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:18.584378 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-df394558-7a1d-45cd-b558-2626cca476ea tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:18.586010 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-df394558-7a1d-45cd-b558-2626cca476ea tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:18.586998 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-df394558-7a1d-45cd-b558-2626cca476ea tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:18.615602 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG dbcounter [-] [117671] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:18.788208 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-df394558-7a1d-45cd-b558-2626cca476ea tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebdf8e3cd1b44dcba37cdcfb4af7db2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a8e1d26bdfc400ebd1e070b09db615e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:37:18.807894 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-df394558-7a1d-45cd-b558-2626cca476ea tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] 10.222.0.30 "GET /compute/v2.1/servers/f116c8d4-a63e-47e1-bb50-ec64f735bfcc" status: 200 len: 1663 microversion: 2.1 time: 0.243196 Jun 16 18:37:18.816112 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 384/805] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:37:18 2022] GET /compute/v2.1/servers/f116c8d4-a63e-47e1-bb50-ec64f735bfcc => generated 1663 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:37:18.916285 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-f2f858ed-b99b-4b83-9f4a-ff579f94ecad tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:37:18.917546 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-f2f858ed-b99b-4b83-9f4a-ff579f94ecad tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] [instance: 858d3b02-c17d-4868-8adc-08e94d31c29c] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:37:18.929904 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-f2f858ed-b99b-4b83-9f4a-ff579f94ecad tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:18.930650 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-f2f858ed-b99b-4b83-9f4a-ff579f94ecad tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:18.931787 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-f2f858ed-b99b-4b83-9f4a-ff579f94ecad tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:18.932490 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-f2f858ed-b99b-4b83-9f4a-ff579f94ecad tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:19.215341 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-f2f858ed-b99b-4b83-9f4a-ff579f94ecad tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc31f4b39704173858410ae52ac2c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9f254f568e4bd98b2e4087c3a32c04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:37:19.226608 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-f2f858ed-b99b-4b83-9f4a-ff579f94ecad tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] 10.222.0.30 "GET /compute/v2.1/servers/858d3b02-c17d-4868-8adc-08e94d31c29c" status: 200 len: 1519 microversion: 2.1 time: 0.315953 Jun 16 18:37:19.227665 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 422/806] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:37:18 2022] GET /compute/v2.1/servers/858d3b02-c17d-4868-8adc-08e94d31c29c => generated 1519 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:37:19.530128 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-37442e57-e002-4297-85f8-f0486e1baf11 tempest-VolumesActionsTest-894713622 tempest-VolumesActionsTest-894713622-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-678410134", "imageRef": "38ef083a-a9ff-4836-8954-f770268ba205", "flavorRef": "452", "networks": [{"uuid": "9d9b8d75-d0fb-447f-8dad-2c97a0fd61de"}]}} {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:37:19.619469 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.network.neutron [None req-37442e57-e002-4297-85f8-f0486e1baf11 tempest-VolumesActionsTest-894713622 tempest-VolumesActionsTest-894713622-project] validate_networks() for [('9d9b8d75-d0fb-447f-8dad-2c97a0fd61de', None, None, None, None, None)] {{(pid=117671) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 18:37:19.829488 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-b5f9a966-47b4-449a-b56f-1bbff2017701 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:37:19.830951 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-b5f9a966-47b4-449a-b56f-1bbff2017701 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] [instance: f116c8d4-a63e-47e1-bb50-ec64f735bfcc] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:37:19.841318 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-b5f9a966-47b4-449a-b56f-1bbff2017701 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:19.842374 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-b5f9a966-47b4-449a-b56f-1bbff2017701 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:19.843296 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-b5f9a966-47b4-449a-b56f-1bbff2017701 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:19.844339 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-b5f9a966-47b4-449a-b56f-1bbff2017701 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:20.121950 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-b5f9a966-47b4-449a-b56f-1bbff2017701 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebdf8e3cd1b44dcba37cdcfb4af7db2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a8e1d26bdfc400ebd1e070b09db615e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:37:20.139621 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-b5f9a966-47b4-449a-b56f-1bbff2017701 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] 10.222.0.30 "GET /compute/v2.1/servers/f116c8d4-a63e-47e1-bb50-ec64f735bfcc" status: 200 len: 1663 microversion: 2.1 time: 0.314615 Jun 16 18:37:20.140862 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 423/807] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:37:19 2022] GET /compute/v2.1/servers/f116c8d4-a63e-47e1-bb50-ec64f735bfcc => generated 1663 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:37:20.194278 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.virt.hardware [None req-37442e57-e002-4297-85f8-f0486e1baf11 tempest-VolumesActionsTest-894713622 tempest-VolumesActionsTest-894713622-project] Flavor limits 0:0:0 {{(pid=117671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 18:37:20.195051 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.virt.hardware [None req-37442e57-e002-4297-85f8-f0486e1baf11 tempest-VolumesActionsTest-894713622 tempest-VolumesActionsTest-894713622-project] Image limits 0:0:0 {{(pid=117671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 18:37:20.196198 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.virt.hardware [None req-37442e57-e002-4297-85f8-f0486e1baf11 tempest-VolumesActionsTest-894713622 tempest-VolumesActionsTest-894713622-project] Flavor pref 0:0:0 {{(pid=117671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 18:37:20.197018 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.virt.hardware [None req-37442e57-e002-4297-85f8-f0486e1baf11 tempest-VolumesActionsTest-894713622 tempest-VolumesActionsTest-894713622-project] Image pref 0:0:0 {{(pid=117671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 18:37:20.197712 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.virt.hardware [None req-37442e57-e002-4297-85f8-f0486e1baf11 tempest-VolumesActionsTest-894713622 tempest-VolumesActionsTest-894713622-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 18:37:20.213896 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-37442e57-e002-4297-85f8-f0486e1baf11 tempest-VolumesActionsTest-894713622 tempest-VolumesActionsTest-894713622-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:20.214714 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-37442e57-e002-4297-85f8-f0486e1baf11 tempest-VolumesActionsTest-894713622 tempest-VolumesActionsTest-894713622-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:20.216168 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-37442e57-e002-4297-85f8-f0486e1baf11 tempest-VolumesActionsTest-894713622 tempest-VolumesActionsTest-894713622-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:20.216916 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-37442e57-e002-4297-85f8-f0486e1baf11 tempest-VolumesActionsTest-894713622 tempest-VolumesActionsTest-894713622-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:20.248277 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-626dce58-44bf-4fa2-a969-9b5a7db7ed65 tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:37:20.248972 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-626dce58-44bf-4fa2-a969-9b5a7db7ed65 tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] [instance: 858d3b02-c17d-4868-8adc-08e94d31c29c] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:37:20.254071 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.quota [None req-37442e57-e002-4297-85f8-f0486e1baf11 tempest-VolumesActionsTest-894713622 tempest-VolumesActionsTest-894713622-project] Getting quotas for project 4283712d27ef4a748657f3bf788ba2c7. Resources: {'instances', 'ram', 'cores'} {{(pid=117671) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 18:37:20.255912 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-626dce58-44bf-4fa2-a969-9b5a7db7ed65 tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:20.256413 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-626dce58-44bf-4fa2-a969-9b5a7db7ed65 tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:20.257439 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-626dce58-44bf-4fa2-a969-9b5a7db7ed65 tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:20.258080 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-626dce58-44bf-4fa2-a969-9b5a7db7ed65 tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:20.264702 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.quota [None req-37442e57-e002-4297-85f8-f0486e1baf11 tempest-VolumesActionsTest-894713622 tempest-VolumesActionsTest-894713622-project] Getting quotas for user 5ffb4685481844bc871c5b2607b5aadb and project 4283712d27ef4a748657f3bf788ba2c7. Resources: {'instances', 'ram', 'cores'} {{(pid=117671) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 18:37:20.280815 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-37442e57-e002-4297-85f8-f0486e1baf11 tempest-VolumesActionsTest-894713622 tempest-VolumesActionsTest-894713622-project] Going to run 1 instances... {{(pid=117671) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 18:37:20.283270 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-37442e57-e002-4297-85f8-f0486e1baf11 tempest-VolumesActionsTest-894713622 tempest-VolumesActionsTest-894713622-project] [instance: c3bbfdf3-e25b-48fc-ae85-2406aa6cc51a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='38ef083a-a9ff-4836-8954-f770268ba205',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117671) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 18:37:20.341943 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-37442e57-e002-4297-85f8-f0486e1baf11 tempest-VolumesActionsTest-894713622 tempest-VolumesActionsTest-894713622-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.816166 Jun 16 18:37:20.343063 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 385/808] 10.222.0.30 () {60 vars in 1146 bytes} [Thu Jun 16 18:37:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 818 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 18:37:20.348591 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [req-7bd0a595-fadc-4c75-a6ff-48bd244b8471 req-d5bc3457-d8f4-41a9-8b35-b365fd146e33 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "858d3b02-c17d-4868-8adc-08e94d31c29c", "name": "network-vif-unplugged", "status": "completed", "tag": "68356597-c3ad-4071-ac45-b2f7aa7bca35"}]} {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:37:20.361207 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [req-7bd0a595-fadc-4c75-a6ff-48bd244b8471 req-d5bc3457-d8f4-41a9-8b35-b365fd146e33 service nova] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:20.363599 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [req-7bd0a595-fadc-4c75-a6ff-48bd244b8471 req-d5bc3457-d8f4-41a9-8b35-b365fd146e33 service nova] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:20.380938 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.compute.server_external_events [req-7bd0a595-fadc-4c75-a6ff-48bd244b8471 req-d5bc3457-d8f4-41a9-8b35-b365fd146e33 service nova] Creating event network-vif-unplugged:68356597-c3ad-4071-ac45-b2f7aa7bca35 for instance 858d3b02-c17d-4868-8adc-08e94d31c29c on hv-cinder-81322 Jun 16 18:37:20.396847 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [req-7bd0a595-fadc-4c75-a6ff-48bd244b8471 req-d5bc3457-d8f4-41a9-8b35-b365fd146e33 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.052108 Jun 16 18:37:20.399186 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 386/809] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Jun 16 18:37:20 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:37:20.406988 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-2cf63b30-fa27-40ef-9cab-08ef56927d37 tempest-VolumesActionsTest-894713622 tempest-VolumesActionsTest-894713622-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:37:20.408164 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-2cf63b30-fa27-40ef-9cab-08ef56927d37 tempest-VolumesActionsTest-894713622 tempest-VolumesActionsTest-894713622-project] [instance: c3bbfdf3-e25b-48fc-ae85-2406aa6cc51a] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:37:20.534710 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-2cf63b30-fa27-40ef-9cab-08ef56927d37 tempest-VolumesActionsTest-894713622 tempest-VolumesActionsTest-894713622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ffb4685481844bc871c5b2607b5aadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4283712d27ef4a748657f3bf788ba2c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:37:20.555467 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-2cf63b30-fa27-40ef-9cab-08ef56927d37 tempest-VolumesActionsTest-894713622 tempest-VolumesActionsTest-894713622-project] 10.222.0.30 "GET /compute/v2.1/servers/c3bbfdf3-e25b-48fc-ae85-2406aa6cc51a" status: 200 len: 1213 microversion: 2.1 time: 0.153850 Jun 16 18:37:20.556633 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 387/810] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:37:20 2022] GET /compute/v2.1/servers/c3bbfdf3-e25b-48fc-ae85-2406aa6cc51a => generated 1213 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:37:20.696755 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-626dce58-44bf-4fa2-a969-9b5a7db7ed65 tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc31f4b39704173858410ae52ac2c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9f254f568e4bd98b2e4087c3a32c04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:37:20.712407 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-626dce58-44bf-4fa2-a969-9b5a7db7ed65 tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] 10.222.0.30 "GET /compute/v2.1/servers/858d3b02-c17d-4868-8adc-08e94d31c29c" status: 200 len: 1575 microversion: 2.1 time: 0.467329 Jun 16 18:37:20.713753 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 424/811] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:37:20 2022] GET /compute/v2.1/servers/858d3b02-c17d-4868-8adc-08e94d31c29c => generated 1575 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:37:21.169324 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-87473d2c-2809-4739-b631-d47bb24aa0ce tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:37:21.170059 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-87473d2c-2809-4739-b631-d47bb24aa0ce tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] [instance: f116c8d4-a63e-47e1-bb50-ec64f735bfcc] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:37:21.181661 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-87473d2c-2809-4739-b631-d47bb24aa0ce tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:21.182109 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-87473d2c-2809-4739-b631-d47bb24aa0ce tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:21.183189 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-87473d2c-2809-4739-b631-d47bb24aa0ce tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:21.183670 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-87473d2c-2809-4739-b631-d47bb24aa0ce tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:21.372809 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-87473d2c-2809-4739-b631-d47bb24aa0ce tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebdf8e3cd1b44dcba37cdcfb4af7db2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a8e1d26bdfc400ebd1e070b09db615e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:37:21.381761 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-87473d2c-2809-4739-b631-d47bb24aa0ce tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] 10.222.0.30 "GET /compute/v2.1/servers/f116c8d4-a63e-47e1-bb50-ec64f735bfcc" status: 200 len: 1667 microversion: 2.1 time: 0.219619 Jun 16 18:37:21.382347 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 388/812] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:37:21 2022] GET /compute/v2.1/servers/f116c8d4-a63e-47e1-bb50-ec64f735bfcc => generated 1667 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:37:21.575638 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-4c362eed-6806-429c-801f-5c23f9dcb59f tempest-VolumesActionsTest-894713622 tempest-VolumesActionsTest-894713622-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:37:21.576831 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-4c362eed-6806-429c-801f-5c23f9dcb59f tempest-VolumesActionsTest-894713622 tempest-VolumesActionsTest-894713622-project] [instance: c3bbfdf3-e25b-48fc-ae85-2406aa6cc51a] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:37:21.586526 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-4c362eed-6806-429c-801f-5c23f9dcb59f tempest-VolumesActionsTest-894713622 tempest-VolumesActionsTest-894713622-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:21.587258 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-4c362eed-6806-429c-801f-5c23f9dcb59f tempest-VolumesActionsTest-894713622 tempest-VolumesActionsTest-894713622-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:21.588573 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-4c362eed-6806-429c-801f-5c23f9dcb59f tempest-VolumesActionsTest-894713622 tempest-VolumesActionsTest-894713622-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:21.589449 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-4c362eed-6806-429c-801f-5c23f9dcb59f tempest-VolumesActionsTest-894713622 tempest-VolumesActionsTest-894713622-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:21.664343 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-4c362eed-6806-429c-801f-5c23f9dcb59f tempest-VolumesActionsTest-894713622 tempest-VolumesActionsTest-894713622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ffb4685481844bc871c5b2607b5aadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4283712d27ef4a748657f3bf788ba2c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:37:21.680003 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-4c362eed-6806-429c-801f-5c23f9dcb59f tempest-VolumesActionsTest-894713622 tempest-VolumesActionsTest-894713622-project] 10.222.0.30 "GET /compute/v2.1/servers/c3bbfdf3-e25b-48fc-ae85-2406aa6cc51a" status: 200 len: 1265 microversion: 2.1 time: 0.109481 Jun 16 18:37:21.681059 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 425/813] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:37:21 2022] GET /compute/v2.1/servers/c3bbfdf3-e25b-48fc-ae85-2406aa6cc51a => generated 1265 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:37:21.731712 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-4e288054-4f8f-4ade-9fe9-b806868b8c17 tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:37:21.732781 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-4e288054-4f8f-4ade-9fe9-b806868b8c17 tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] [instance: 858d3b02-c17d-4868-8adc-08e94d31c29c] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:37:21.741563 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-4e288054-4f8f-4ade-9fe9-b806868b8c17 tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:21.742013 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-4e288054-4f8f-4ade-9fe9-b806868b8c17 tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:21.742871 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-4e288054-4f8f-4ade-9fe9-b806868b8c17 tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:21.743285 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-4e288054-4f8f-4ade-9fe9-b806868b8c17 tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:22.083735 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-4e288054-4f8f-4ade-9fe9-b806868b8c17 tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc31f4b39704173858410ae52ac2c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9f254f568e4bd98b2e4087c3a32c04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:37:22.095169 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-4e288054-4f8f-4ade-9fe9-b806868b8c17 tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] 10.222.0.30 "GET /compute/v2.1/servers/858d3b02-c17d-4868-8adc-08e94d31c29c" status: 200 len: 1575 microversion: 2.1 time: 0.367433 Jun 16 18:37:22.096260 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 389/814] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:37:21 2022] GET /compute/v2.1/servers/858d3b02-c17d-4868-8adc-08e94d31c29c => generated 1575 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:37:22.703018 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-289cecb7-a46f-4b06-8b05-625af35f926e tempest-VolumesActionsTest-894713622 tempest-VolumesActionsTest-894713622-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:37:22.703870 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-289cecb7-a46f-4b06-8b05-625af35f926e tempest-VolumesActionsTest-894713622 tempest-VolumesActionsTest-894713622-project] [instance: c3bbfdf3-e25b-48fc-ae85-2406aa6cc51a] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:37:22.713112 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-289cecb7-a46f-4b06-8b05-625af35f926e tempest-VolumesActionsTest-894713622 tempest-VolumesActionsTest-894713622-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:22.713560 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-289cecb7-a46f-4b06-8b05-625af35f926e tempest-VolumesActionsTest-894713622 tempest-VolumesActionsTest-894713622-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:22.714352 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-289cecb7-a46f-4b06-8b05-625af35f926e tempest-VolumesActionsTest-894713622 tempest-VolumesActionsTest-894713622-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:22.714798 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-289cecb7-a46f-4b06-8b05-625af35f926e tempest-VolumesActionsTest-894713622 tempest-VolumesActionsTest-894713622-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:22.830744 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-289cecb7-a46f-4b06-8b05-625af35f926e tempest-VolumesActionsTest-894713622 tempest-VolumesActionsTest-894713622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ffb4685481844bc871c5b2607b5aadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4283712d27ef4a748657f3bf788ba2c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:37:22.843600 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-289cecb7-a46f-4b06-8b05-625af35f926e tempest-VolumesActionsTest-894713622 tempest-VolumesActionsTest-894713622-project] 10.222.0.30 "GET /compute/v2.1/servers/c3bbfdf3-e25b-48fc-ae85-2406aa6cc51a" status: 200 len: 1271 microversion: 2.1 time: 0.145437 Jun 16 18:37:22.845084 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 426/815] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:37:22 2022] GET /compute/v2.1/servers/c3bbfdf3-e25b-48fc-ae85-2406aa6cc51a => generated 1271 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:37:23.115169 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-3ea5f383-2b56-4bea-9a2a-97780825f6db tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:37:23.115828 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-3ea5f383-2b56-4bea-9a2a-97780825f6db tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] [instance: 858d3b02-c17d-4868-8adc-08e94d31c29c] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:37:23.123751 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-3ea5f383-2b56-4bea-9a2a-97780825f6db tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:23.124242 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-3ea5f383-2b56-4bea-9a2a-97780825f6db tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:23.125021 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-3ea5f383-2b56-4bea-9a2a-97780825f6db tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:23.125458 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-3ea5f383-2b56-4bea-9a2a-97780825f6db tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:23.391331 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-3ea5f383-2b56-4bea-9a2a-97780825f6db tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc31f4b39704173858410ae52ac2c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9f254f568e4bd98b2e4087c3a32c04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:37:23.401919 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-3ea5f383-2b56-4bea-9a2a-97780825f6db tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] 10.222.0.30 "GET /compute/v2.1/servers/858d3b02-c17d-4868-8adc-08e94d31c29c" status: 200 len: 1575 microversion: 2.1 time: 0.290767 Jun 16 18:37:23.403113 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 390/816] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:37:23 2022] GET /compute/v2.1/servers/858d3b02-c17d-4868-8adc-08e94d31c29c => generated 1575 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:37:23.873793 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-4f100e09-1f7d-4c2c-9681-77a819aeb256 tempest-VolumesActionsTest-894713622 tempest-VolumesActionsTest-894713622-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:37:23.875269 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-4f100e09-1f7d-4c2c-9681-77a819aeb256 tempest-VolumesActionsTest-894713622 tempest-VolumesActionsTest-894713622-project] [instance: c3bbfdf3-e25b-48fc-ae85-2406aa6cc51a] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:37:23.887381 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-4f100e09-1f7d-4c2c-9681-77a819aeb256 tempest-VolumesActionsTest-894713622 tempest-VolumesActionsTest-894713622-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:23.888005 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-4f100e09-1f7d-4c2c-9681-77a819aeb256 tempest-VolumesActionsTest-894713622 tempest-VolumesActionsTest-894713622-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:23.889029 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-4f100e09-1f7d-4c2c-9681-77a819aeb256 tempest-VolumesActionsTest-894713622 tempest-VolumesActionsTest-894713622-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:23.889736 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-4f100e09-1f7d-4c2c-9681-77a819aeb256 tempest-VolumesActionsTest-894713622 tempest-VolumesActionsTest-894713622-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:24.064323 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-4f100e09-1f7d-4c2c-9681-77a819aeb256 tempest-VolumesActionsTest-894713622 tempest-VolumesActionsTest-894713622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ffb4685481844bc871c5b2607b5aadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4283712d27ef4a748657f3bf788ba2c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:37:24.067245 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [req-2cfffc50-29d2-4550-85a5-98ac3b16898f req-401494c2-3da9-45ca-974c-13b88091f03b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c3bbfdf3-e25b-48fc-ae85-2406aa6cc51a", "tag": "f17c469b-b0df-4dbb-ac2f-d66f29c54ca2"}]} {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:37:24.082406 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-4f100e09-1f7d-4c2c-9681-77a819aeb256 tempest-VolumesActionsTest-894713622 tempest-VolumesActionsTest-894713622-project] 10.222.0.30 "GET /compute/v2.1/servers/c3bbfdf3-e25b-48fc-ae85-2406aa6cc51a" status: 200 len: 1313 microversion: 2.1 time: 0.215020 Jun 16 18:37:24.092040 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 427/817] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:37:23 2022] GET /compute/v2.1/servers/c3bbfdf3-e25b-48fc-ae85-2406aa6cc51a => generated 1313 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:37:24.095044 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [req-2cfffc50-29d2-4550-85a5-98ac3b16898f req-401494c2-3da9-45ca-974c-13b88091f03b service nova] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:24.095821 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [req-2cfffc50-29d2-4550-85a5-98ac3b16898f req-401494c2-3da9-45ca-974c-13b88091f03b service nova] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:24.109256 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.compute.server_external_events [req-2cfffc50-29d2-4550-85a5-98ac3b16898f req-401494c2-3da9-45ca-974c-13b88091f03b service nova] Creating event network-changed:f17c469b-b0df-4dbb-ac2f-d66f29c54ca2 for instance c3bbfdf3-e25b-48fc-ae85-2406aa6cc51a on hv-cinder-81322 Jun 16 18:37:24.117012 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [req-2cfffc50-29d2-4550-85a5-98ac3b16898f req-401494c2-3da9-45ca-974c-13b88091f03b service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055410 Jun 16 18:37:24.118139 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 391/818] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Jun 16 18:37:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 18:37:24.433016 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-ed7fd6a0-a4ca-41d9-83d2-910d4150ea64 tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:37:24.433670 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-ed7fd6a0-a4ca-41d9-83d2-910d4150ea64 tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] [instance: 858d3b02-c17d-4868-8adc-08e94d31c29c] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:37:24.441034 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-ed7fd6a0-a4ca-41d9-83d2-910d4150ea64 tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:24.441918 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-ed7fd6a0-a4ca-41d9-83d2-910d4150ea64 tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:24.442469 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-ed7fd6a0-a4ca-41d9-83d2-910d4150ea64 tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:24.442947 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-ed7fd6a0-a4ca-41d9-83d2-910d4150ea64 tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:24.638670 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-ed7fd6a0-a4ca-41d9-83d2-910d4150ea64 tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc31f4b39704173858410ae52ac2c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9f254f568e4bd98b2e4087c3a32c04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:37:24.650114 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-ed7fd6a0-a4ca-41d9-83d2-910d4150ea64 tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] 10.222.0.30 "GET /compute/v2.1/servers/858d3b02-c17d-4868-8adc-08e94d31c29c" status: 200 len: 1575 microversion: 2.1 time: 0.220906 Jun 16 18:37:24.662293 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 428/819] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:37:24 2022] GET /compute/v2.1/servers/858d3b02-c17d-4868-8adc-08e94d31c29c => generated 1575 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:37:25.100195 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-6930b9c3-9ca1-47dd-b47f-90cc32f35d9f tempest-VolumesActionsTest-894713622 tempest-VolumesActionsTest-894713622-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:37:25.100909 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-6930b9c3-9ca1-47dd-b47f-90cc32f35d9f tempest-VolumesActionsTest-894713622 tempest-VolumesActionsTest-894713622-project] [instance: c3bbfdf3-e25b-48fc-ae85-2406aa6cc51a] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:37:25.108608 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-6930b9c3-9ca1-47dd-b47f-90cc32f35d9f tempest-VolumesActionsTest-894713622 tempest-VolumesActionsTest-894713622-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:25.109068 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-6930b9c3-9ca1-47dd-b47f-90cc32f35d9f tempest-VolumesActionsTest-894713622 tempest-VolumesActionsTest-894713622-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:25.109900 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-6930b9c3-9ca1-47dd-b47f-90cc32f35d9f tempest-VolumesActionsTest-894713622 tempest-VolumesActionsTest-894713622-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:25.110334 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-6930b9c3-9ca1-47dd-b47f-90cc32f35d9f tempest-VolumesActionsTest-894713622 tempest-VolumesActionsTest-894713622-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:25.286545 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-6930b9c3-9ca1-47dd-b47f-90cc32f35d9f tempest-VolumesActionsTest-894713622 tempest-VolumesActionsTest-894713622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ffb4685481844bc871c5b2607b5aadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4283712d27ef4a748657f3bf788ba2c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:37:25.294850 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-6930b9c3-9ca1-47dd-b47f-90cc32f35d9f tempest-VolumesActionsTest-894713622 tempest-VolumesActionsTest-894713622-project] 10.222.0.30 "GET /compute/v2.1/servers/c3bbfdf3-e25b-48fc-ae85-2406aa6cc51a" status: 200 len: 1313 microversion: 2.1 time: 0.199589 Jun 16 18:37:25.295442 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 392/820] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:37:25 2022] GET /compute/v2.1/servers/c3bbfdf3-e25b-48fc-ae85-2406aa6cc51a => generated 1313 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:37:25.673323 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-f121a68e-893c-42d2-bcdb-f3242c961c18 tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:37:25.675260 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-f121a68e-893c-42d2-bcdb-f3242c961c18 tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] [instance: 858d3b02-c17d-4868-8adc-08e94d31c29c] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:37:25.683847 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-f121a68e-893c-42d2-bcdb-f3242c961c18 tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:25.684437 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-f121a68e-893c-42d2-bcdb-f3242c961c18 tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:25.685246 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-f121a68e-893c-42d2-bcdb-f3242c961c18 tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:25.685690 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-f121a68e-893c-42d2-bcdb-f3242c961c18 tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:25.883239 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-f121a68e-893c-42d2-bcdb-f3242c961c18 tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc31f4b39704173858410ae52ac2c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9f254f568e4bd98b2e4087c3a32c04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:37:25.899479 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-f121a68e-893c-42d2-bcdb-f3242c961c18 tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] 10.222.0.30 "GET /compute/v2.1/servers/858d3b02-c17d-4868-8adc-08e94d31c29c" status: 200 len: 1575 microversion: 2.1 time: 0.231638 Jun 16 18:37:25.900524 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 429/821] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:37:25 2022] GET /compute/v2.1/servers/858d3b02-c17d-4868-8adc-08e94d31c29c => generated 1575 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:37:26.313478 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-5b4b4ac8-ebdf-410e-85b7-f94a306d98c2 tempest-VolumesActionsTest-894713622 tempest-VolumesActionsTest-894713622-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:37:26.314060 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-5b4b4ac8-ebdf-410e-85b7-f94a306d98c2 tempest-VolumesActionsTest-894713622 tempest-VolumesActionsTest-894713622-project] [instance: c3bbfdf3-e25b-48fc-ae85-2406aa6cc51a] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:37:26.322229 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-5b4b4ac8-ebdf-410e-85b7-f94a306d98c2 tempest-VolumesActionsTest-894713622 tempest-VolumesActionsTest-894713622-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:26.322676 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-5b4b4ac8-ebdf-410e-85b7-f94a306d98c2 tempest-VolumesActionsTest-894713622 tempest-VolumesActionsTest-894713622-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:26.323453 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-5b4b4ac8-ebdf-410e-85b7-f94a306d98c2 tempest-VolumesActionsTest-894713622 tempest-VolumesActionsTest-894713622-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:26.323881 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-5b4b4ac8-ebdf-410e-85b7-f94a306d98c2 tempest-VolumesActionsTest-894713622 tempest-VolumesActionsTest-894713622-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:26.476646 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-5b4b4ac8-ebdf-410e-85b7-f94a306d98c2 tempest-VolumesActionsTest-894713622 tempest-VolumesActionsTest-894713622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ffb4685481844bc871c5b2607b5aadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4283712d27ef4a748657f3bf788ba2c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:37:26.485215 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-5b4b4ac8-ebdf-410e-85b7-f94a306d98c2 tempest-VolumesActionsTest-894713622 tempest-VolumesActionsTest-894713622-project] 10.222.0.30 "GET /compute/v2.1/servers/c3bbfdf3-e25b-48fc-ae85-2406aa6cc51a" status: 200 len: 1313 microversion: 2.1 time: 0.176202 Jun 16 18:37:26.485805 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 393/822] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:37:26 2022] GET /compute/v2.1/servers/c3bbfdf3-e25b-48fc-ae85-2406aa6cc51a => generated 1313 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:37:26.929055 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-08efadf2-6ef6-4d3a-995d-374c4a97be58 tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:37:26.929796 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-08efadf2-6ef6-4d3a-995d-374c4a97be58 tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] [instance: 858d3b02-c17d-4868-8adc-08e94d31c29c] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:37:26.938745 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-08efadf2-6ef6-4d3a-995d-374c4a97be58 tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:26.939264 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-08efadf2-6ef6-4d3a-995d-374c4a97be58 tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:26.941133 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-08efadf2-6ef6-4d3a-995d-374c4a97be58 tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:26.941806 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-08efadf2-6ef6-4d3a-995d-374c4a97be58 tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:27.129872 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-08efadf2-6ef6-4d3a-995d-374c4a97be58 tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc31f4b39704173858410ae52ac2c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9f254f568e4bd98b2e4087c3a32c04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:37:27.137769 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-08efadf2-6ef6-4d3a-995d-374c4a97be58 tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] 10.222.0.30 "GET /compute/v2.1/servers/858d3b02-c17d-4868-8adc-08e94d31c29c" status: 200 len: 1575 microversion: 2.1 time: 0.213509 Jun 16 18:37:27.138421 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 430/823] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:37:26 2022] GET /compute/v2.1/servers/858d3b02-c17d-4868-8adc-08e94d31c29c => generated 1575 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:37:27.508283 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-7470d4c5-848e-4da4-9a57-da0713b579d9 tempest-VolumesActionsTest-894713622 tempest-VolumesActionsTest-894713622-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:37:27.509415 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-7470d4c5-848e-4da4-9a57-da0713b579d9 tempest-VolumesActionsTest-894713622 tempest-VolumesActionsTest-894713622-project] [instance: c3bbfdf3-e25b-48fc-ae85-2406aa6cc51a] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:37:27.521277 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-7470d4c5-848e-4da4-9a57-da0713b579d9 tempest-VolumesActionsTest-894713622 tempest-VolumesActionsTest-894713622-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:27.521949 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-7470d4c5-848e-4da4-9a57-da0713b579d9 tempest-VolumesActionsTest-894713622 tempest-VolumesActionsTest-894713622-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:27.523145 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-7470d4c5-848e-4da4-9a57-da0713b579d9 tempest-VolumesActionsTest-894713622 tempest-VolumesActionsTest-894713622-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:27.523926 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-7470d4c5-848e-4da4-9a57-da0713b579d9 tempest-VolumesActionsTest-894713622 tempest-VolumesActionsTest-894713622-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:27.700700 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-7470d4c5-848e-4da4-9a57-da0713b579d9 tempest-VolumesActionsTest-894713622 tempest-VolumesActionsTest-894713622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ffb4685481844bc871c5b2607b5aadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4283712d27ef4a748657f3bf788ba2c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:37:27.710303 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-7470d4c5-848e-4da4-9a57-da0713b579d9 tempest-VolumesActionsTest-894713622 tempest-VolumesActionsTest-894713622-project] 10.222.0.30 "GET /compute/v2.1/servers/c3bbfdf3-e25b-48fc-ae85-2406aa6cc51a" status: 200 len: 1313 microversion: 2.1 time: 0.210434 Jun 16 18:37:27.710950 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 394/824] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:37:27 2022] GET /compute/v2.1/servers/c3bbfdf3-e25b-48fc-ae85-2406aa6cc51a => generated 1313 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:37:28.155957 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-9aa7b8b6-ffa6-4c1f-86a2-9aa303f64311 tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:37:28.156956 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-9aa7b8b6-ffa6-4c1f-86a2-9aa303f64311 tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] [instance: 858d3b02-c17d-4868-8adc-08e94d31c29c] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:37:28.160026 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG dbcounter [-] [117670] Writing DB stats nova_api:SELECT=51 {{(pid=117670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:28.166231 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-9aa7b8b6-ffa6-4c1f-86a2-9aa303f64311 tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:28.166678 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-9aa7b8b6-ffa6-4c1f-86a2-9aa303f64311 tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:28.167462 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-9aa7b8b6-ffa6-4c1f-86a2-9aa303f64311 tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:28.167903 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-9aa7b8b6-ffa6-4c1f-86a2-9aa303f64311 tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:28.336215 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-9aa7b8b6-ffa6-4c1f-86a2-9aa303f64311 tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc31f4b39704173858410ae52ac2c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9f254f568e4bd98b2e4087c3a32c04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:37:28.345405 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-9aa7b8b6-ffa6-4c1f-86a2-9aa303f64311 tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] 10.222.0.30 "GET /compute/v2.1/servers/858d3b02-c17d-4868-8adc-08e94d31c29c" status: 200 len: 1575 microversion: 2.1 time: 0.193311 Jun 16 18:37:28.345998 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 431/825] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:37:28 2022] GET /compute/v2.1/servers/858d3b02-c17d-4868-8adc-08e94d31c29c => generated 1575 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:37:28.729105 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-2246277d-3154-4afb-9da4-5f1b51c407b5 tempest-VolumesActionsTest-894713622 tempest-VolumesActionsTest-894713622-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:37:28.730247 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-2246277d-3154-4afb-9da4-5f1b51c407b5 tempest-VolumesActionsTest-894713622 tempest-VolumesActionsTest-894713622-project] [instance: c3bbfdf3-e25b-48fc-ae85-2406aa6cc51a] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:37:28.732758 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG dbcounter [-] [117671] Writing DB stats nova_api:SELECT=68,nova_api:INSERT=3 {{(pid=117671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:28.740220 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-2246277d-3154-4afb-9da4-5f1b51c407b5 tempest-VolumesActionsTest-894713622 tempest-VolumesActionsTest-894713622-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:28.740924 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-2246277d-3154-4afb-9da4-5f1b51c407b5 tempest-VolumesActionsTest-894713622 tempest-VolumesActionsTest-894713622-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:28.741810 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-2246277d-3154-4afb-9da4-5f1b51c407b5 tempest-VolumesActionsTest-894713622 tempest-VolumesActionsTest-894713622-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:28.742402 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-2246277d-3154-4afb-9da4-5f1b51c407b5 tempest-VolumesActionsTest-894713622 tempest-VolumesActionsTest-894713622-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:28.937317 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-2246277d-3154-4afb-9da4-5f1b51c407b5 tempest-VolumesActionsTest-894713622 tempest-VolumesActionsTest-894713622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ffb4685481844bc871c5b2607b5aadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4283712d27ef4a748657f3bf788ba2c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:37:28.947710 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-2246277d-3154-4afb-9da4-5f1b51c407b5 tempest-VolumesActionsTest-894713622 tempest-VolumesActionsTest-894713622-project] 10.222.0.30 "GET /compute/v2.1/servers/c3bbfdf3-e25b-48fc-ae85-2406aa6cc51a" status: 200 len: 1313 microversion: 2.1 time: 0.223036 Jun 16 18:37:28.948355 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 395/826] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:37:28 2022] GET /compute/v2.1/servers/c3bbfdf3-e25b-48fc-ae85-2406aa6cc51a => generated 1313 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:37:29.371297 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-0d4b4d58-99e8-4b73-9503-25ec4d20b2b5 tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:37:29.371952 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-0d4b4d58-99e8-4b73-9503-25ec4d20b2b5 tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] [instance: 858d3b02-c17d-4868-8adc-08e94d31c29c] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:37:29.380163 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-0d4b4d58-99e8-4b73-9503-25ec4d20b2b5 tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:29.380628 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-0d4b4d58-99e8-4b73-9503-25ec4d20b2b5 tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:29.381428 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-0d4b4d58-99e8-4b73-9503-25ec4d20b2b5 tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:29.381867 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-0d4b4d58-99e8-4b73-9503-25ec4d20b2b5 tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:29.546545 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-0d4b4d58-99e8-4b73-9503-25ec4d20b2b5 tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc31f4b39704173858410ae52ac2c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9f254f568e4bd98b2e4087c3a32c04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:37:29.555818 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-0d4b4d58-99e8-4b73-9503-25ec4d20b2b5 tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] 10.222.0.30 "GET /compute/v2.1/servers/858d3b02-c17d-4868-8adc-08e94d31c29c" status: 200 len: 1575 microversion: 2.1 time: 0.188520 Jun 16 18:37:29.556890 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 432/827] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:37:29 2022] GET /compute/v2.1/servers/858d3b02-c17d-4868-8adc-08e94d31c29c => generated 1575 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:37:29.966422 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-04e7f1b4-3e80-473d-a51f-ed1b93069532 tempest-VolumesActionsTest-894713622 tempest-VolumesActionsTest-894713622-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:37:29.967062 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-04e7f1b4-3e80-473d-a51f-ed1b93069532 tempest-VolumesActionsTest-894713622 tempest-VolumesActionsTest-894713622-project] [instance: c3bbfdf3-e25b-48fc-ae85-2406aa6cc51a] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:37:29.975511 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-04e7f1b4-3e80-473d-a51f-ed1b93069532 tempest-VolumesActionsTest-894713622 tempest-VolumesActionsTest-894713622-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:29.975966 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-04e7f1b4-3e80-473d-a51f-ed1b93069532 tempest-VolumesActionsTest-894713622 tempest-VolumesActionsTest-894713622-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:29.976791 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-04e7f1b4-3e80-473d-a51f-ed1b93069532 tempest-VolumesActionsTest-894713622 tempest-VolumesActionsTest-894713622-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:29.977235 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-04e7f1b4-3e80-473d-a51f-ed1b93069532 tempest-VolumesActionsTest-894713622 tempest-VolumesActionsTest-894713622-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:30.136300 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-04e7f1b4-3e80-473d-a51f-ed1b93069532 tempest-VolumesActionsTest-894713622 tempest-VolumesActionsTest-894713622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ffb4685481844bc871c5b2607b5aadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4283712d27ef4a748657f3bf788ba2c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:37:30.147462 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-04e7f1b4-3e80-473d-a51f-ed1b93069532 tempest-VolumesActionsTest-894713622 tempest-VolumesActionsTest-894713622-project] 10.222.0.30 "GET /compute/v2.1/servers/c3bbfdf3-e25b-48fc-ae85-2406aa6cc51a" status: 200 len: 1313 microversion: 2.1 time: 0.184330 Jun 16 18:37:30.149074 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 396/828] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:37:29 2022] GET /compute/v2.1/servers/c3bbfdf3-e25b-48fc-ae85-2406aa6cc51a => generated 1313 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:37:30.586971 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-5ef58f1f-b0dc-4252-925f-2dbef0fbe6c4 tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:37:30.588475 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-5ef58f1f-b0dc-4252-925f-2dbef0fbe6c4 tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] [instance: 858d3b02-c17d-4868-8adc-08e94d31c29c] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:37:30.601328 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-5ef58f1f-b0dc-4252-925f-2dbef0fbe6c4 tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:30.602143 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-5ef58f1f-b0dc-4252-925f-2dbef0fbe6c4 tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:30.603611 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-5ef58f1f-b0dc-4252-925f-2dbef0fbe6c4 tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:30.604455 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-5ef58f1f-b0dc-4252-925f-2dbef0fbe6c4 tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:30.703720 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [req-a67a5b38-ae5e-4e7b-a896-ead901c194bc req-541175dd-39ad-48c3-b2d9-b8e7f1f97cfc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c3bbfdf3-e25b-48fc-ae85-2406aa6cc51a", "name": "network-vif-plugged", "status": "completed", "tag": "f17c469b-b0df-4dbb-ac2f-d66f29c54ca2"}]} {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:37:30.711239 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG dbcounter [-] [117671] Writing DB stats nova_cell0:SELECT=2 {{(pid=117671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:30.713259 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG dbcounter [-] [117671] Writing DB stats nova_cell0:SELECT=8 {{(pid=117671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:30.720796 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [req-a67a5b38-ae5e-4e7b-a896-ead901c194bc req-541175dd-39ad-48c3-b2d9-b8e7f1f97cfc service nova] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:30.720796 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [req-a67a5b38-ae5e-4e7b-a896-ead901c194bc req-541175dd-39ad-48c3-b2d9-b8e7f1f97cfc service nova] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:30.744457 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.compute.server_external_events [req-a67a5b38-ae5e-4e7b-a896-ead901c194bc req-541175dd-39ad-48c3-b2d9-b8e7f1f97cfc service nova] Creating event network-vif-plugged:f17c469b-b0df-4dbb-ac2f-d66f29c54ca2 for instance c3bbfdf3-e25b-48fc-ae85-2406aa6cc51a on hv-cinder-81322 Jun 16 18:37:30.751518 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [req-a67a5b38-ae5e-4e7b-a896-ead901c194bc req-541175dd-39ad-48c3-b2d9-b8e7f1f97cfc service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054128 Jun 16 18:37:30.753496 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 397/829] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Jun 16 18:37:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 18:37:30.866720 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-5ef58f1f-b0dc-4252-925f-2dbef0fbe6c4 tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc31f4b39704173858410ae52ac2c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9f254f568e4bd98b2e4087c3a32c04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:37:30.881153 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-5ef58f1f-b0dc-4252-925f-2dbef0fbe6c4 tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] 10.222.0.30 "GET /compute/v2.1/servers/858d3b02-c17d-4868-8adc-08e94d31c29c" status: 200 len: 1575 microversion: 2.1 time: 0.301433 Jun 16 18:37:30.882619 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 433/830] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:37:30 2022] GET /compute/v2.1/servers/858d3b02-c17d-4868-8adc-08e94d31c29c => generated 1575 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:37:31.172900 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-74fa2ea5-42af-4d06-9a0f-909dc670644b tempest-VolumesActionsTest-894713622 tempest-VolumesActionsTest-894713622-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:37:31.173808 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-74fa2ea5-42af-4d06-9a0f-909dc670644b tempest-VolumesActionsTest-894713622 tempest-VolumesActionsTest-894713622-project] [instance: c3bbfdf3-e25b-48fc-ae85-2406aa6cc51a] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:37:31.183788 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-74fa2ea5-42af-4d06-9a0f-909dc670644b tempest-VolumesActionsTest-894713622 tempest-VolumesActionsTest-894713622-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:31.184483 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-74fa2ea5-42af-4d06-9a0f-909dc670644b tempest-VolumesActionsTest-894713622 tempest-VolumesActionsTest-894713622-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:31.185249 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-74fa2ea5-42af-4d06-9a0f-909dc670644b tempest-VolumesActionsTest-894713622 tempest-VolumesActionsTest-894713622-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:31.185866 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-74fa2ea5-42af-4d06-9a0f-909dc670644b tempest-VolumesActionsTest-894713622 tempest-VolumesActionsTest-894713622-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:31.375155 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-74fa2ea5-42af-4d06-9a0f-909dc670644b tempest-VolumesActionsTest-894713622 tempest-VolumesActionsTest-894713622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ffb4685481844bc871c5b2607b5aadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4283712d27ef4a748657f3bf788ba2c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:37:31.383923 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-74fa2ea5-42af-4d06-9a0f-909dc670644b tempest-VolumesActionsTest-894713622 tempest-VolumesActionsTest-894713622-project] 10.222.0.30 "GET /compute/v2.1/servers/c3bbfdf3-e25b-48fc-ae85-2406aa6cc51a" status: 200 len: 1313 microversion: 2.1 time: 0.216994 Jun 16 18:37:31.384536 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 398/831] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:37:31 2022] GET /compute/v2.1/servers/c3bbfdf3-e25b-48fc-ae85-2406aa6cc51a => generated 1313 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:37:31.903793 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-204664ef-ccd6-4e55-a8a4-d3ee6952cacb tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:37:31.904549 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-204664ef-ccd6-4e55-a8a4-d3ee6952cacb tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] [instance: 858d3b02-c17d-4868-8adc-08e94d31c29c] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:37:31.912500 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-204664ef-ccd6-4e55-a8a4-d3ee6952cacb tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:31.912964 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-204664ef-ccd6-4e55-a8a4-d3ee6952cacb tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:31.913750 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-204664ef-ccd6-4e55-a8a4-d3ee6952cacb tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:31.914191 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-204664ef-ccd6-4e55-a8a4-d3ee6952cacb tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:31.946263 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG dbcounter [-] [117670] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:32.098462 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-204664ef-ccd6-4e55-a8a4-d3ee6952cacb tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc31f4b39704173858410ae52ac2c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9f254f568e4bd98b2e4087c3a32c04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:37:32.112965 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-204664ef-ccd6-4e55-a8a4-d3ee6952cacb tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] 10.222.0.30 "GET /compute/v2.1/servers/858d3b02-c17d-4868-8adc-08e94d31c29c" status: 200 len: 1575 microversion: 2.1 time: 0.212402 Jun 16 18:37:32.114010 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 434/832] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:37:31 2022] GET /compute/v2.1/servers/858d3b02-c17d-4868-8adc-08e94d31c29c => generated 1575 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:37:32.405083 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-9ababaed-bfce-41ae-96e3-602f5cadee62 tempest-VolumesActionsTest-894713622 tempest-VolumesActionsTest-894713622-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:37:32.406224 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-9ababaed-bfce-41ae-96e3-602f5cadee62 tempest-VolumesActionsTest-894713622 tempest-VolumesActionsTest-894713622-project] [instance: c3bbfdf3-e25b-48fc-ae85-2406aa6cc51a] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:37:32.419286 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-9ababaed-bfce-41ae-96e3-602f5cadee62 tempest-VolumesActionsTest-894713622 tempest-VolumesActionsTest-894713622-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:32.419805 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-9ababaed-bfce-41ae-96e3-602f5cadee62 tempest-VolumesActionsTest-894713622 tempest-VolumesActionsTest-894713622-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:32.421111 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-9ababaed-bfce-41ae-96e3-602f5cadee62 tempest-VolumesActionsTest-894713622 tempest-VolumesActionsTest-894713622-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:32.421541 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-9ababaed-bfce-41ae-96e3-602f5cadee62 tempest-VolumesActionsTest-894713622 tempest-VolumesActionsTest-894713622-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:32.626304 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-9ababaed-bfce-41ae-96e3-602f5cadee62 tempest-VolumesActionsTest-894713622 tempest-VolumesActionsTest-894713622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ffb4685481844bc871c5b2607b5aadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4283712d27ef4a748657f3bf788ba2c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:37:32.637601 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-9ababaed-bfce-41ae-96e3-602f5cadee62 tempest-VolumesActionsTest-894713622 tempest-VolumesActionsTest-894713622-project] 10.222.0.30 "GET /compute/v2.1/servers/c3bbfdf3-e25b-48fc-ae85-2406aa6cc51a" status: 200 len: 1313 microversion: 2.1 time: 0.239520 Jun 16 18:37:32.638196 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 399/833] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:37:32 2022] GET /compute/v2.1/servers/c3bbfdf3-e25b-48fc-ae85-2406aa6cc51a => generated 1313 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:37:32.775001 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [req-759d30e9-9803-429f-a8ab-25b101f5899f req-d88cf25c-55f5-49e2-9891-5bf11f501ade service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "858d3b02-c17d-4868-8adc-08e94d31c29c", "name": "network-vif-plugged", "status": "completed", "tag": "68356597-c3ad-4071-ac45-b2f7aa7bca35"}]} {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:37:32.787686 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [req-759d30e9-9803-429f-a8ab-25b101f5899f req-d88cf25c-55f5-49e2-9891-5bf11f501ade service nova] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:32.788175 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [req-759d30e9-9803-429f-a8ab-25b101f5899f req-d88cf25c-55f5-49e2-9891-5bf11f501ade service nova] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:32.807878 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.compute.server_external_events [req-759d30e9-9803-429f-a8ab-25b101f5899f req-d88cf25c-55f5-49e2-9891-5bf11f501ade service nova] Creating event network-vif-plugged:68356597-c3ad-4071-ac45-b2f7aa7bca35 for instance 858d3b02-c17d-4868-8adc-08e94d31c29c on hv-cinder-81322 Jun 16 18:37:32.814388 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [req-759d30e9-9803-429f-a8ab-25b101f5899f req-d88cf25c-55f5-49e2-9891-5bf11f501ade service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043239 Jun 16 18:37:32.815975 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 435/834] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Jun 16 18:37:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:37:33.139569 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-612c8c0b-f4bd-4506-9bf1-81ef7b6db868 tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:37:33.140286 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-612c8c0b-f4bd-4506-9bf1-81ef7b6db868 tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] [instance: 858d3b02-c17d-4868-8adc-08e94d31c29c] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:37:33.147770 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-612c8c0b-f4bd-4506-9bf1-81ef7b6db868 tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:33.148259 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-612c8c0b-f4bd-4506-9bf1-81ef7b6db868 tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:33.149121 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-612c8c0b-f4bd-4506-9bf1-81ef7b6db868 tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:33.149507 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-612c8c0b-f4bd-4506-9bf1-81ef7b6db868 tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:33.318496 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-612c8c0b-f4bd-4506-9bf1-81ef7b6db868 tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc31f4b39704173858410ae52ac2c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9f254f568e4bd98b2e4087c3a32c04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:37:33.326875 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-612c8c0b-f4bd-4506-9bf1-81ef7b6db868 tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] 10.222.0.30 "GET /compute/v2.1/servers/858d3b02-c17d-4868-8adc-08e94d31c29c" status: 200 len: 1575 microversion: 2.1 time: 0.191368 Jun 16 18:37:33.327341 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 400/835] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:37:33 2022] GET /compute/v2.1/servers/858d3b02-c17d-4868-8adc-08e94d31c29c => generated 1575 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:37:33.656173 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-3bd34c0c-0468-4169-8aee-fce43e38fc76 tempest-VolumesActionsTest-894713622 tempest-VolumesActionsTest-894713622-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:37:33.657297 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-3bd34c0c-0468-4169-8aee-fce43e38fc76 tempest-VolumesActionsTest-894713622 tempest-VolumesActionsTest-894713622-project] [instance: c3bbfdf3-e25b-48fc-ae85-2406aa6cc51a] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:37:33.665511 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-3bd34c0c-0468-4169-8aee-fce43e38fc76 tempest-VolumesActionsTest-894713622 tempest-VolumesActionsTest-894713622-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:33.665961 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-3bd34c0c-0468-4169-8aee-fce43e38fc76 tempest-VolumesActionsTest-894713622 tempest-VolumesActionsTest-894713622-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:33.666801 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-3bd34c0c-0468-4169-8aee-fce43e38fc76 tempest-VolumesActionsTest-894713622 tempest-VolumesActionsTest-894713622-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:33.667244 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-3bd34c0c-0468-4169-8aee-fce43e38fc76 tempest-VolumesActionsTest-894713622 tempest-VolumesActionsTest-894713622-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:33.821202 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-3bd34c0c-0468-4169-8aee-fce43e38fc76 tempest-VolumesActionsTest-894713622 tempest-VolumesActionsTest-894713622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ffb4685481844bc871c5b2607b5aadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4283712d27ef4a748657f3bf788ba2c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:37:33.829175 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-3bd34c0c-0468-4169-8aee-fce43e38fc76 tempest-VolumesActionsTest-894713622 tempest-VolumesActionsTest-894713622-project] 10.222.0.30 "GET /compute/v2.1/servers/c3bbfdf3-e25b-48fc-ae85-2406aa6cc51a" status: 200 len: 1496 microversion: 2.1 time: 0.177758 Jun 16 18:37:33.829775 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 436/836] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:37:33 2022] GET /compute/v2.1/servers/c3bbfdf3-e25b-48fc-ae85-2406aa6cc51a => generated 1496 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:37:34.302134 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-7fdc8325-fc20-4032-a25f-8a5bc971dc62 tempest-VolumesActionsTest-894713622 tempest-VolumesActionsTest-894713622-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:37:34.302997 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-7fdc8325-fc20-4032-a25f-8a5bc971dc62 tempest-VolumesActionsTest-894713622 tempest-VolumesActionsTest-894713622-project] [instance: c3bbfdf3-e25b-48fc-ae85-2406aa6cc51a] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:37:34.309937 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-7fdc8325-fc20-4032-a25f-8a5bc971dc62 tempest-VolumesActionsTest-894713622 tempest-VolumesActionsTest-894713622-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:34.310395 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-7fdc8325-fc20-4032-a25f-8a5bc971dc62 tempest-VolumesActionsTest-894713622 tempest-VolumesActionsTest-894713622-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:34.311194 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-7fdc8325-fc20-4032-a25f-8a5bc971dc62 tempest-VolumesActionsTest-894713622 tempest-VolumesActionsTest-894713622-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:34.311642 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-7fdc8325-fc20-4032-a25f-8a5bc971dc62 tempest-VolumesActionsTest-894713622 tempest-VolumesActionsTest-894713622-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:34.342749 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-7fdc8325-fc20-4032-a25f-8a5bc971dc62 tempest-VolumesActionsTest-894713622 tempest-VolumesActionsTest-894713622-project] [instance: c3bbfdf3-e25b-48fc-ae85-2406aa6cc51a] Going to try to terminate instance {{(pid=117671) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 18:37:34.344374 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-0adb4303-2f2a-4e38-896c-df9e2cd9691a tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:37:34.345327 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-0adb4303-2f2a-4e38-896c-df9e2cd9691a tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] [instance: 858d3b02-c17d-4868-8adc-08e94d31c29c] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:37:34.355642 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-0adb4303-2f2a-4e38-896c-df9e2cd9691a tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:34.356473 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-0adb4303-2f2a-4e38-896c-df9e2cd9691a tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:34.357973 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-0adb4303-2f2a-4e38-896c-df9e2cd9691a tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:34.359060 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-0adb4303-2f2a-4e38-896c-df9e2cd9691a tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:34.450454 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-7fdc8325-fc20-4032-a25f-8a5bc971dc62 tempest-VolumesActionsTest-894713622 tempest-VolumesActionsTest-894713622-project] 10.222.0.30 "DELETE /compute/v2.1/servers/c3bbfdf3-e25b-48fc-ae85-2406aa6cc51a" status: 204 len: 0 microversion: 2.1 time: 0.153618 Jun 16 18:37:34.451440 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 401/837] 10.222.0.30 () {58 vars in 1238 bytes} [Thu Jun 16 18:37:34 2022] DELETE /compute/v2.1/servers/c3bbfdf3-e25b-48fc-ae85-2406aa6cc51a => generated 0 bytes in 156 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 18:37:34.467205 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-5161fa39-3ea6-442c-ae13-efc65902280d tempest-VolumesActionsTest-894713622 tempest-VolumesActionsTest-894713622-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:37:34.468638 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-5161fa39-3ea6-442c-ae13-efc65902280d tempest-VolumesActionsTest-894713622 tempest-VolumesActionsTest-894713622-project] [instance: c3bbfdf3-e25b-48fc-ae85-2406aa6cc51a] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:37:34.482993 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-5161fa39-3ea6-442c-ae13-efc65902280d tempest-VolumesActionsTest-894713622 tempest-VolumesActionsTest-894713622-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:34.483781 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-5161fa39-3ea6-442c-ae13-efc65902280d tempest-VolumesActionsTest-894713622 tempest-VolumesActionsTest-894713622-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:34.485237 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-5161fa39-3ea6-442c-ae13-efc65902280d tempest-VolumesActionsTest-894713622 tempest-VolumesActionsTest-894713622-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:34.486006 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-5161fa39-3ea6-442c-ae13-efc65902280d tempest-VolumesActionsTest-894713622 tempest-VolumesActionsTest-894713622-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:34.573210 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-0adb4303-2f2a-4e38-896c-df9e2cd9691a tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc31f4b39704173858410ae52ac2c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9f254f568e4bd98b2e4087c3a32c04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:37:34.590248 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-0adb4303-2f2a-4e38-896c-df9e2cd9691a tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] 10.222.0.30 "GET /compute/v2.1/servers/858d3b02-c17d-4868-8adc-08e94d31c29c" status: 200 len: 1575 microversion: 2.1 time: 0.249672 Jun 16 18:37:34.591739 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 437/838] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:37:34 2022] GET /compute/v2.1/servers/858d3b02-c17d-4868-8adc-08e94d31c29c => generated 1575 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:37:34.703785 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-5161fa39-3ea6-442c-ae13-efc65902280d tempest-VolumesActionsTest-894713622 tempest-VolumesActionsTest-894713622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ffb4685481844bc871c5b2607b5aadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4283712d27ef4a748657f3bf788ba2c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:37:34.713004 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-5161fa39-3ea6-442c-ae13-efc65902280d tempest-VolumesActionsTest-894713622 tempest-VolumesActionsTest-894713622-project] 10.222.0.30 "GET /compute/v2.1/servers/c3bbfdf3-e25b-48fc-ae85-2406aa6cc51a" status: 200 len: 1502 microversion: 2.1 time: 0.254446 Jun 16 18:37:34.713604 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 402/839] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:37:34 2022] GET /compute/v2.1/servers/c3bbfdf3-e25b-48fc-ae85-2406aa6cc51a => generated 1502 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:37:35.616560 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-8d4fcdca-f94c-49fb-87e4-48f018c7f599 tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:37:35.617336 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-8d4fcdca-f94c-49fb-87e4-48f018c7f599 tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] [instance: 858d3b02-c17d-4868-8adc-08e94d31c29c] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:37:35.624588 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-8d4fcdca-f94c-49fb-87e4-48f018c7f599 tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:35.625084 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-8d4fcdca-f94c-49fb-87e4-48f018c7f599 tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:35.626055 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-8d4fcdca-f94c-49fb-87e4-48f018c7f599 tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:35.626532 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-8d4fcdca-f94c-49fb-87e4-48f018c7f599 tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:35.733357 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-a1bad899-9d3d-4b73-a174-724ec5f3877b tempest-VolumesActionsTest-894713622 tempest-VolumesActionsTest-894713622-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:37:35.734956 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-a1bad899-9d3d-4b73-a174-724ec5f3877b tempest-VolumesActionsTest-894713622 tempest-VolumesActionsTest-894713622-project] [instance: c3bbfdf3-e25b-48fc-ae85-2406aa6cc51a] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:37:35.744941 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-a1bad899-9d3d-4b73-a174-724ec5f3877b tempest-VolumesActionsTest-894713622 tempest-VolumesActionsTest-894713622-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:35.745426 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-a1bad899-9d3d-4b73-a174-724ec5f3877b tempest-VolumesActionsTest-894713622 tempest-VolumesActionsTest-894713622-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:35.746213 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-a1bad899-9d3d-4b73-a174-724ec5f3877b tempest-VolumesActionsTest-894713622 tempest-VolumesActionsTest-894713622-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:35.746652 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-a1bad899-9d3d-4b73-a174-724ec5f3877b tempest-VolumesActionsTest-894713622 tempest-VolumesActionsTest-894713622-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:35.751731 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG dbcounter [-] [117671] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:35.818081 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-8d4fcdca-f94c-49fb-87e4-48f018c7f599 tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc31f4b39704173858410ae52ac2c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9f254f568e4bd98b2e4087c3a32c04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:37:35.827230 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-8d4fcdca-f94c-49fb-87e4-48f018c7f599 tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] 10.222.0.30 "GET /compute/v2.1/servers/858d3b02-c17d-4868-8adc-08e94d31c29c" status: 200 len: 1562 microversion: 2.1 time: 0.215873 Jun 16 18:37:35.827984 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 438/840] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:37:35 2022] GET /compute/v2.1/servers/858d3b02-c17d-4868-8adc-08e94d31c29c => generated 1562 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:37:35.949986 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-a1bad899-9d3d-4b73-a174-724ec5f3877b tempest-VolumesActionsTest-894713622 tempest-VolumesActionsTest-894713622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ffb4685481844bc871c5b2607b5aadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4283712d27ef4a748657f3bf788ba2c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:37:35.960226 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-a1bad899-9d3d-4b73-a174-724ec5f3877b tempest-VolumesActionsTest-894713622 tempest-VolumesActionsTest-894713622-project] 10.222.0.30 "GET /compute/v2.1/servers/c3bbfdf3-e25b-48fc-ae85-2406aa6cc51a" status: 200 len: 1502 microversion: 2.1 time: 0.231517 Jun 16 18:37:35.961806 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 403/841] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:37:35 2022] GET /compute/v2.1/servers/c3bbfdf3-e25b-48fc-ae85-2406aa6cc51a => generated 1502 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:37:36.910793 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [req-da8e0fae-4e77-4fc0-babb-dce4a0710f41 req-dcc0444a-8def-49c8-888a-52c6b1fe1759 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c3bbfdf3-e25b-48fc-ae85-2406aa6cc51a", "name": "network-vif-deleted", "tag": "f17c469b-b0df-4dbb-ac2f-d66f29c54ca2"}]} {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:37:36.926894 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [req-da8e0fae-4e77-4fc0-babb-dce4a0710f41 req-dcc0444a-8def-49c8-888a-52c6b1fe1759 service nova] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:36.927661 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [req-da8e0fae-4e77-4fc0-babb-dce4a0710f41 req-dcc0444a-8def-49c8-888a-52c6b1fe1759 service nova] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:36.944702 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.compute.server_external_events [req-da8e0fae-4e77-4fc0-babb-dce4a0710f41 req-dcc0444a-8def-49c8-888a-52c6b1fe1759 service nova] Creating event network-vif-deleted:f17c469b-b0df-4dbb-ac2f-d66f29c54ca2 for instance c3bbfdf3-e25b-48fc-ae85-2406aa6cc51a on hv-cinder-81322 Jun 16 18:37:36.952014 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [req-da8e0fae-4e77-4fc0-babb-dce4a0710f41 req-dcc0444a-8def-49c8-888a-52c6b1fe1759 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048306 Jun 16 18:37:36.953415 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 439/842] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Jun 16 18:37:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 18:37:36.984743 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-dfc00f1c-b1c5-480a-81d7-906149828f2f tempest-VolumesActionsTest-894713622 tempest-VolumesActionsTest-894713622-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:37:36.985633 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-dfc00f1c-b1c5-480a-81d7-906149828f2f tempest-VolumesActionsTest-894713622 tempest-VolumesActionsTest-894713622-project] [instance: c3bbfdf3-e25b-48fc-ae85-2406aa6cc51a] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:37:36.996232 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-dfc00f1c-b1c5-480a-81d7-906149828f2f tempest-VolumesActionsTest-894713622 tempest-VolumesActionsTest-894713622-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:36.996827 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-dfc00f1c-b1c5-480a-81d7-906149828f2f tempest-VolumesActionsTest-894713622 tempest-VolumesActionsTest-894713622-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:36.997822 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-dfc00f1c-b1c5-480a-81d7-906149828f2f tempest-VolumesActionsTest-894713622 tempest-VolumesActionsTest-894713622-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:36.998558 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-dfc00f1c-b1c5-480a-81d7-906149828f2f tempest-VolumesActionsTest-894713622 tempest-VolumesActionsTest-894713622-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:37.044334 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-dfc00f1c-b1c5-480a-81d7-906149828f2f tempest-VolumesActionsTest-894713622 tempest-VolumesActionsTest-894713622-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:37.045042 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-dfc00f1c-b1c5-480a-81d7-906149828f2f tempest-VolumesActionsTest-894713622 tempest-VolumesActionsTest-894713622-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:37.045753 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.objects.instance [None req-dfc00f1c-b1c5-480a-81d7-906149828f2f tempest-VolumesActionsTest-894713622 tempest-VolumesActionsTest-894713622-project] Lazy-loading 'fault' on Instance uuid c3bbfdf3-e25b-48fc-ae85-2406aa6cc51a {{(pid=117671) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 18:37:37.102668 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-dfc00f1c-b1c5-480a-81d7-906149828f2f tempest-VolumesActionsTest-894713622 tempest-VolumesActionsTest-894713622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ffb4685481844bc871c5b2607b5aadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4283712d27ef4a748657f3bf788ba2c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:37:37.113205 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-dfc00f1c-b1c5-480a-81d7-906149828f2f tempest-VolumesActionsTest-894713622 tempest-VolumesActionsTest-894713622-project] 10.222.0.30 "GET /compute/v2.1/servers/c3bbfdf3-e25b-48fc-ae85-2406aa6cc51a" status: 200 len: 1303 microversion: 2.1 time: 0.132138 Jun 16 18:37:37.113996 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 404/843] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:37:36 2022] GET /compute/v2.1/servers/c3bbfdf3-e25b-48fc-ae85-2406aa6cc51a => generated 1303 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:37:38.133334 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-fb606ed8-8bfc-445a-989b-ab8f0ca25db5 tempest-VolumesActionsTest-894713622 tempest-VolumesActionsTest-894713622-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:37:38.134157 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-fb606ed8-8bfc-445a-989b-ab8f0ca25db5 tempest-VolumesActionsTest-894713622 tempest-VolumesActionsTest-894713622-project] [instance: c3bbfdf3-e25b-48fc-ae85-2406aa6cc51a] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:37:38.141042 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-fb606ed8-8bfc-445a-989b-ab8f0ca25db5 tempest-VolumesActionsTest-894713622 tempest-VolumesActionsTest-894713622-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:38.141491 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-fb606ed8-8bfc-445a-989b-ab8f0ca25db5 tempest-VolumesActionsTest-894713622 tempest-VolumesActionsTest-894713622-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:38.142272 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-fb606ed8-8bfc-445a-989b-ab8f0ca25db5 tempest-VolumesActionsTest-894713622 tempest-VolumesActionsTest-894713622-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:38.142726 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-fb606ed8-8bfc-445a-989b-ab8f0ca25db5 tempest-VolumesActionsTest-894713622 tempest-VolumesActionsTest-894713622-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:38.158269 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.wsgi [None req-fb606ed8-8bfc-445a-989b-ab8f0ca25db5 tempest-VolumesActionsTest-894713622 tempest-VolumesActionsTest-894713622-project] HTTP exception thrown: Instance c3bbfdf3-e25b-48fc-ae85-2406aa6cc51a could not be found. Jun 16 18:37:38.160005 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-fb606ed8-8bfc-445a-989b-ab8f0ca25db5 tempest-VolumesActionsTest-894713622 tempest-VolumesActionsTest-894713622-project] Request method failure captured: Jun 16 18:37:38.160005 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: request: GET /compute/v2.1/servers/c3bbfdf3-e25b-48fc-ae85-2406aa6cc51a HTTP/1.1 Jun 16 18:37:38.160005 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: Accept: application/json Jun 16 18:37:38.160005 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: Accept-Encoding: identity Jun 16 18:37:38.160005 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: Connection: close Jun 16 18:37:38.160005 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: Content-Length: 0 Jun 16 18:37:38.160005 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: Content-Type: application/json Jun 16 18:37:38.160005 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: Host: 10.222.0.30 Jun 16 18:37:38.160005 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: Openstack-System-Scope: None Jun 16 18:37:38.160005 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: User-Agent: python-urllib3/1.26.9 Jun 16 18:37:38.160005 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Auth-Token: gAAAAABiq3hdeMw4Cm6gBPNmBBkBgCZN6hv8kJ7wWtW8kxJjdCog7Y8wcX6SXXIw9K-IA0mJxWUEzWdh15sjcopLKUS5nj9mJurGbzb8GUGt5FYbBM0EUJ6CFeVFt743UuqrlhgHRx57kff9CgjzcJ-BTL1pzHgbBiOcJ-mFJdxOLe9MtNsZdCI Jun 16 18:37:38.160005 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Domain-Id: None Jun 16 18:37:38.160005 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Domain-Name: None Jun 16 18:37:38.160005 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Identity-Status: Confirmed Jun 16 18:37:38.160005 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Is-Admin-Project: True Jun 16 18:37:38.160005 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Project-Domain-Id: default Jun 16 18:37:38.160005 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Project-Domain-Name: Default Jun 16 18:37:38.160005 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Project-Id: 4283712d27ef4a748657f3bf788ba2c7 Jun 16 18:37:38.160005 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Project-Name: tempest-VolumesActionsTest-894713622 Jun 16 18:37:38.160005 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Role: reader,member Jun 16 18:37:38.160005 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Roles: reader,member Jun 16 18:37:38.162564 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/4283712d27ef4a748657f3bf788ba2c7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/4283712d27ef4a748657f3bf788ba2c7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_4283712d27ef4a748657f3bf788ba2c7", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/4283712d27ef4a748657f3bf788ba2c7"}]}] Jun 16 18:37:38.162564 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Tenant: tempest-VolumesActionsTest-894713622 Jun 16 18:37:38.162564 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Tenant-Id: 4283712d27ef4a748657f3bf788ba2c7 Jun 16 18:37:38.162564 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Tenant-Name: tempest-VolumesActionsTest-894713622 Jun 16 18:37:38.162564 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-User: tempest-VolumesActionsTest-894713622-project Jun 16 18:37:38.162564 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-User-Domain-Id: default Jun 16 18:37:38.162564 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-User-Domain-Name: Default Jun 16 18:37:38.162564 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-User-Id: 5ffb4685481844bc871c5b2607b5aadb Jun 16 18:37:38.162564 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-User-Name: tempest-VolumesActionsTest-894713622-project Jun 16 18:37:38.162564 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: method: > Jun 16 18:37:38.162564 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: exception: Instance c3bbfdf3-e25b-48fc-ae85-2406aa6cc51a could not be found. Jun 16 18:37:38.162564 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: action_args: {'id': 'c3bbfdf3-e25b-48fc-ae85-2406aa6cc51a'} Jun 16 18:37:38.164188 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:37:38.164188 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:37:38.164188 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 18:37:38.164188 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 18:37:38.164188 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 18:37:38.164188 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 18:37:38.164188 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 18:37:38.164188 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 18:37:38.164188 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 18:37:38.164188 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 18:37:38.164188 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c3bbfdf3-e25b-48fc-ae85-2406aa6cc51a could not be found. Jun 16 18:37:38.164188 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi Jun 16 18:37:38.164188 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:37:38.164188 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi Jun 16 18:37:38.164188 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:37:38.164188 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:37:38.164188 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:37:38.164188 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:37:38.164188 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:37:38.164188 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:37:38.166620 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:37:38.166620 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 18:37:38.166620 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 18:37:38.166620 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 18:37:38.166620 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 18:37:38.166620 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 18:37:38.166620 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:37:38.166620 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c3bbfdf3-e25b-48fc-ae85-2406aa6cc51a could not be found. Jun 16 18:37:38.166620 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi Jun 16 18:37:38.166620 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:37:38.166620 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi Jun 16 18:37:38.166620 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:37:38.166620 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:37:38.166620 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:37:38.166620 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:37:38.166620 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:37:38.166620 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c3bbfdf3-e25b-48fc-ae85-2406aa6cc51a could not be found. Jun 16 18:37:38.166620 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi Jun 16 18:37:38.169200 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-fb606ed8-8bfc-445a-989b-ab8f0ca25db5 tempest-VolumesActionsTest-894713622 tempest-VolumesActionsTest-894713622-project] Returning 404 to user: Instance c3bbfdf3-e25b-48fc-ae85-2406aa6cc51a could not be found. {{(pid=117670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:37:38.169200 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-fb606ed8-8bfc-445a-989b-ab8f0ca25db5 tempest-VolumesActionsTest-894713622 tempest-VolumesActionsTest-894713622-project] 10.222.0.30 "GET /compute/v2.1/servers/c3bbfdf3-e25b-48fc-ae85-2406aa6cc51a" status: 404 len: 111 microversion: 2.1 time: 0.032907 Jun 16 18:37:38.169200 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 440/844] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:37:38 2022] GET /compute/v2.1/servers/c3bbfdf3-e25b-48fc-ae85-2406aa6cc51a => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 16 18:37:38.239948 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-bb08d5a3-8d2c-4fdd-bfbd-fa47e4302696 tempest-VolumesActionsTest-894713622 tempest-VolumesActionsTest-894713622-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1491664334", "imageRef": "38ef083a-a9ff-4836-8954-f770268ba205", "flavorRef": "452", "networks": [{"uuid": "9d9b8d75-d0fb-447f-8dad-2c97a0fd61de"}]}} {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:37:38.298170 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.network.neutron [None req-bb08d5a3-8d2c-4fdd-bfbd-fa47e4302696 tempest-VolumesActionsTest-894713622 tempest-VolumesActionsTest-894713622-project] validate_networks() for [('9d9b8d75-d0fb-447f-8dad-2c97a0fd61de', None, None, None, None, None)] {{(pid=117671) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 18:37:38.769998 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.virt.hardware [None req-bb08d5a3-8d2c-4fdd-bfbd-fa47e4302696 tempest-VolumesActionsTest-894713622 tempest-VolumesActionsTest-894713622-project] Flavor limits 0:0:0 {{(pid=117671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 18:37:38.771137 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.virt.hardware [None req-bb08d5a3-8d2c-4fdd-bfbd-fa47e4302696 tempest-VolumesActionsTest-894713622 tempest-VolumesActionsTest-894713622-project] Image limits 0:0:0 {{(pid=117671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 18:37:38.771629 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.virt.hardware [None req-bb08d5a3-8d2c-4fdd-bfbd-fa47e4302696 tempest-VolumesActionsTest-894713622 tempest-VolumesActionsTest-894713622-project] Flavor pref 0:0:0 {{(pid=117671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 18:37:38.772228 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.virt.hardware [None req-bb08d5a3-8d2c-4fdd-bfbd-fa47e4302696 tempest-VolumesActionsTest-894713622 tempest-VolumesActionsTest-894713622-project] Image pref 0:0:0 {{(pid=117671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 18:37:38.772670 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.virt.hardware [None req-bb08d5a3-8d2c-4fdd-bfbd-fa47e4302696 tempest-VolumesActionsTest-894713622 tempest-VolumesActionsTest-894713622-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 18:37:38.783204 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-bb08d5a3-8d2c-4fdd-bfbd-fa47e4302696 tempest-VolumesActionsTest-894713622 tempest-VolumesActionsTest-894713622-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:38.784482 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-bb08d5a3-8d2c-4fdd-bfbd-fa47e4302696 tempest-VolumesActionsTest-894713622 tempest-VolumesActionsTest-894713622-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:38.785524 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-bb08d5a3-8d2c-4fdd-bfbd-fa47e4302696 tempest-VolumesActionsTest-894713622 tempest-VolumesActionsTest-894713622-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:38.786422 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-bb08d5a3-8d2c-4fdd-bfbd-fa47e4302696 tempest-VolumesActionsTest-894713622 tempest-VolumesActionsTest-894713622-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:38.808367 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.quota [None req-bb08d5a3-8d2c-4fdd-bfbd-fa47e4302696 tempest-VolumesActionsTest-894713622 tempest-VolumesActionsTest-894713622-project] Getting quotas for project 4283712d27ef4a748657f3bf788ba2c7. Resources: {'instances', 'ram', 'cores'} {{(pid=117671) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 18:37:38.813932 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.quota [None req-bb08d5a3-8d2c-4fdd-bfbd-fa47e4302696 tempest-VolumesActionsTest-894713622 tempest-VolumesActionsTest-894713622-project] Getting quotas for user 5ffb4685481844bc871c5b2607b5aadb and project 4283712d27ef4a748657f3bf788ba2c7. Resources: {'instances', 'ram', 'cores'} {{(pid=117671) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 18:37:38.827405 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-bb08d5a3-8d2c-4fdd-bfbd-fa47e4302696 tempest-VolumesActionsTest-894713622 tempest-VolumesActionsTest-894713622-project] Going to run 1 instances... {{(pid=117671) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 18:37:38.829775 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-bb08d5a3-8d2c-4fdd-bfbd-fa47e4302696 tempest-VolumesActionsTest-894713622 tempest-VolumesActionsTest-894713622-project] [instance: 6995a375-72a7-478f-803d-9954f14518fc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='38ef083a-a9ff-4836-8954-f770268ba205',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117671) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 18:37:38.882794 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-bb08d5a3-8d2c-4fdd-bfbd-fa47e4302696 tempest-VolumesActionsTest-894713622 tempest-VolumesActionsTest-894713622-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.647512 Jun 16 18:37:38.883775 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 405/845] 10.222.0.30 () {60 vars in 1146 bytes} [Thu Jun 16 18:37:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 649 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 16 18:37:38.897291 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-0e0e9b79-ff86-43e3-891e-ffac135f984c tempest-VolumesActionsTest-894713622 tempest-VolumesActionsTest-894713622-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:37:38.898167 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-0e0e9b79-ff86-43e3-891e-ffac135f984c tempest-VolumesActionsTest-894713622 tempest-VolumesActionsTest-894713622-project] [instance: 6995a375-72a7-478f-803d-9954f14518fc] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:37:38.990828 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-0e0e9b79-ff86-43e3-891e-ffac135f984c tempest-VolumesActionsTest-894713622 tempest-VolumesActionsTest-894713622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ffb4685481844bc871c5b2607b5aadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4283712d27ef4a748657f3bf788ba2c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:37:39.004999 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-0e0e9b79-ff86-43e3-891e-ffac135f984c tempest-VolumesActionsTest-894713622 tempest-VolumesActionsTest-894713622-project] 10.222.0.30 "GET /compute/v2.1/servers/6995a375-72a7-478f-803d-9954f14518fc" status: 200 len: 1214 microversion: 2.1 time: 0.113725 Jun 16 18:37:39.006065 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 441/846] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:37:38 2022] GET /compute/v2.1/servers/6995a375-72a7-478f-803d-9954f14518fc => generated 1214 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:37:40.032635 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-3e172ecf-f738-45e3-adef-73cc84b724c8 tempest-VolumesActionsTest-894713622 tempest-VolumesActionsTest-894713622-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:37:40.034004 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-3e172ecf-f738-45e3-adef-73cc84b724c8 tempest-VolumesActionsTest-894713622 tempest-VolumesActionsTest-894713622-project] [instance: 6995a375-72a7-478f-803d-9954f14518fc] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:37:40.042684 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-3e172ecf-f738-45e3-adef-73cc84b724c8 tempest-VolumesActionsTest-894713622 tempest-VolumesActionsTest-894713622-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:40.043129 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-3e172ecf-f738-45e3-adef-73cc84b724c8 tempest-VolumesActionsTest-894713622 tempest-VolumesActionsTest-894713622-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:40.044203 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-3e172ecf-f738-45e3-adef-73cc84b724c8 tempest-VolumesActionsTest-894713622 tempest-VolumesActionsTest-894713622-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:40.044647 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-3e172ecf-f738-45e3-adef-73cc84b724c8 tempest-VolumesActionsTest-894713622 tempest-VolumesActionsTest-894713622-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:40.181628 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-3e172ecf-f738-45e3-adef-73cc84b724c8 tempest-VolumesActionsTest-894713622 tempest-VolumesActionsTest-894713622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ffb4685481844bc871c5b2607b5aadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4283712d27ef4a748657f3bf788ba2c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:37:40.192437 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-3e172ecf-f738-45e3-adef-73cc84b724c8 tempest-VolumesActionsTest-894713622 tempest-VolumesActionsTest-894713622-project] 10.222.0.30 "GET /compute/v2.1/servers/6995a375-72a7-478f-803d-9954f14518fc" status: 200 len: 1274 microversion: 2.1 time: 0.163449 Jun 16 18:37:40.193371 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 406/847] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:37:40 2022] GET /compute/v2.1/servers/6995a375-72a7-478f-803d-9954f14518fc => generated 1274 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:37:41.214958 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-d50d89a5-4ea8-418a-8b28-bca581804e91 tempest-VolumesActionsTest-894713622 tempest-VolumesActionsTest-894713622-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:37:41.216324 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-d50d89a5-4ea8-418a-8b28-bca581804e91 tempest-VolumesActionsTest-894713622 tempest-VolumesActionsTest-894713622-project] [instance: 6995a375-72a7-478f-803d-9954f14518fc] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:37:41.229777 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-d50d89a5-4ea8-418a-8b28-bca581804e91 tempest-VolumesActionsTest-894713622 tempest-VolumesActionsTest-894713622-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:41.230229 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-d50d89a5-4ea8-418a-8b28-bca581804e91 tempest-VolumesActionsTest-894713622 tempest-VolumesActionsTest-894713622-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:41.231039 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-d50d89a5-4ea8-418a-8b28-bca581804e91 tempest-VolumesActionsTest-894713622 tempest-VolumesActionsTest-894713622-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:41.231478 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-d50d89a5-4ea8-418a-8b28-bca581804e91 tempest-VolumesActionsTest-894713622 tempest-VolumesActionsTest-894713622-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:41.405706 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-d50d89a5-4ea8-418a-8b28-bca581804e91 tempest-VolumesActionsTest-894713622 tempest-VolumesActionsTest-894713622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ffb4685481844bc871c5b2607b5aadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4283712d27ef4a748657f3bf788ba2c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:37:41.417134 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-d50d89a5-4ea8-418a-8b28-bca581804e91 tempest-VolumesActionsTest-894713622 tempest-VolumesActionsTest-894713622-project] 10.222.0.30 "GET /compute/v2.1/servers/6995a375-72a7-478f-803d-9954f14518fc" status: 200 len: 1314 microversion: 2.1 time: 0.208980 Jun 16 18:37:41.418082 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 442/848] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:37:41 2022] GET /compute/v2.1/servers/6995a375-72a7-478f-803d-9954f14518fc => generated 1314 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:37:41.789793 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [req-2d9546ea-11b2-4d9d-a87f-c519a6055a2b req-43e4f2e7-b649-46bc-8d3e-29e97b64faf1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6995a375-72a7-478f-803d-9954f14518fc", "tag": "6d32c249-3fe4-4c57-a796-53bc6b9dd1d4"}]} {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:37:41.809536 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [req-2d9546ea-11b2-4d9d-a87f-c519a6055a2b req-43e4f2e7-b649-46bc-8d3e-29e97b64faf1 service nova] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:41.810259 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [req-2d9546ea-11b2-4d9d-a87f-c519a6055a2b req-43e4f2e7-b649-46bc-8d3e-29e97b64faf1 service nova] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:41.829333 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.compute.server_external_events [req-2d9546ea-11b2-4d9d-a87f-c519a6055a2b req-43e4f2e7-b649-46bc-8d3e-29e97b64faf1 service nova] Creating event network-changed:6d32c249-3fe4-4c57-a796-53bc6b9dd1d4 for instance 6995a375-72a7-478f-803d-9954f14518fc on hv-cinder-81322 Jun 16 18:37:41.834436 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [req-2d9546ea-11b2-4d9d-a87f-c519a6055a2b req-43e4f2e7-b649-46bc-8d3e-29e97b64faf1 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050808 Jun 16 18:37:41.835175 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 407/849] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Jun 16 18:37:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 18:37:42.437722 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-54d9006f-dd6f-4855-9863-b942f1288a35 tempest-VolumesActionsTest-894713622 tempest-VolumesActionsTest-894713622-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:37:42.438494 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-54d9006f-dd6f-4855-9863-b942f1288a35 tempest-VolumesActionsTest-894713622 tempest-VolumesActionsTest-894713622-project] [instance: 6995a375-72a7-478f-803d-9954f14518fc] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:37:42.445855 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-54d9006f-dd6f-4855-9863-b942f1288a35 tempest-VolumesActionsTest-894713622 tempest-VolumesActionsTest-894713622-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:42.446309 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-54d9006f-dd6f-4855-9863-b942f1288a35 tempest-VolumesActionsTest-894713622 tempest-VolumesActionsTest-894713622-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:42.447154 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-54d9006f-dd6f-4855-9863-b942f1288a35 tempest-VolumesActionsTest-894713622 tempest-VolumesActionsTest-894713622-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:42.447782 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-54d9006f-dd6f-4855-9863-b942f1288a35 tempest-VolumesActionsTest-894713622 tempest-VolumesActionsTest-894713622-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:42.602688 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-54d9006f-dd6f-4855-9863-b942f1288a35 tempest-VolumesActionsTest-894713622 tempest-VolumesActionsTest-894713622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ffb4685481844bc871c5b2607b5aadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4283712d27ef4a748657f3bf788ba2c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:37:42.612540 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-54d9006f-dd6f-4855-9863-b942f1288a35 tempest-VolumesActionsTest-894713622 tempest-VolumesActionsTest-894713622-project] 10.222.0.30 "GET /compute/v2.1/servers/6995a375-72a7-478f-803d-9954f14518fc" status: 200 len: 1314 microversion: 2.1 time: 0.177980 Jun 16 18:37:42.613416 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 443/850] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:37:42 2022] GET /compute/v2.1/servers/6995a375-72a7-478f-803d-9954f14518fc => generated 1314 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:37:43.633302 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-90a4d098-1c21-4a34-bf4e-d4feed91fa0a tempest-VolumesActionsTest-894713622 tempest-VolumesActionsTest-894713622-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:37:43.634074 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-90a4d098-1c21-4a34-bf4e-d4feed91fa0a tempest-VolumesActionsTest-894713622 tempest-VolumesActionsTest-894713622-project] [instance: 6995a375-72a7-478f-803d-9954f14518fc] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:37:43.640994 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-90a4d098-1c21-4a34-bf4e-d4feed91fa0a tempest-VolumesActionsTest-894713622 tempest-VolumesActionsTest-894713622-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:43.641457 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-90a4d098-1c21-4a34-bf4e-d4feed91fa0a tempest-VolumesActionsTest-894713622 tempest-VolumesActionsTest-894713622-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:43.642237 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-90a4d098-1c21-4a34-bf4e-d4feed91fa0a tempest-VolumesActionsTest-894713622 tempest-VolumesActionsTest-894713622-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:43.642686 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-90a4d098-1c21-4a34-bf4e-d4feed91fa0a tempest-VolumesActionsTest-894713622 tempest-VolumesActionsTest-894713622-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:43.806036 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-90a4d098-1c21-4a34-bf4e-d4feed91fa0a tempest-VolumesActionsTest-894713622 tempest-VolumesActionsTest-894713622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ffb4685481844bc871c5b2607b5aadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4283712d27ef4a748657f3bf788ba2c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:37:43.814593 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-90a4d098-1c21-4a34-bf4e-d4feed91fa0a tempest-VolumesActionsTest-894713622 tempest-VolumesActionsTest-894713622-project] 10.222.0.30 "GET /compute/v2.1/servers/6995a375-72a7-478f-803d-9954f14518fc" status: 200 len: 1314 microversion: 2.1 time: 0.187191 Jun 16 18:37:43.815126 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 408/851] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:37:43 2022] GET /compute/v2.1/servers/6995a375-72a7-478f-803d-9954f14518fc => generated 1314 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:37:44.834230 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-fc1cb7ac-f08a-4367-a4fe-f5df1e624241 tempest-VolumesActionsTest-894713622 tempest-VolumesActionsTest-894713622-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:37:44.835236 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-fc1cb7ac-f08a-4367-a4fe-f5df1e624241 tempest-VolumesActionsTest-894713622 tempest-VolumesActionsTest-894713622-project] [instance: 6995a375-72a7-478f-803d-9954f14518fc] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:37:44.843610 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-fc1cb7ac-f08a-4367-a4fe-f5df1e624241 tempest-VolumesActionsTest-894713622 tempest-VolumesActionsTest-894713622-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:44.844208 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-fc1cb7ac-f08a-4367-a4fe-f5df1e624241 tempest-VolumesActionsTest-894713622 tempest-VolumesActionsTest-894713622-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:44.845227 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-fc1cb7ac-f08a-4367-a4fe-f5df1e624241 tempest-VolumesActionsTest-894713622 tempest-VolumesActionsTest-894713622-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:44.845982 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-fc1cb7ac-f08a-4367-a4fe-f5df1e624241 tempest-VolumesActionsTest-894713622 tempest-VolumesActionsTest-894713622-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:45.015109 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-fc1cb7ac-f08a-4367-a4fe-f5df1e624241 tempest-VolumesActionsTest-894713622 tempest-VolumesActionsTest-894713622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ffb4685481844bc871c5b2607b5aadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4283712d27ef4a748657f3bf788ba2c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:37:45.029232 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-fc1cb7ac-f08a-4367-a4fe-f5df1e624241 tempest-VolumesActionsTest-894713622 tempest-VolumesActionsTest-894713622-project] 10.222.0.30 "GET /compute/v2.1/servers/6995a375-72a7-478f-803d-9954f14518fc" status: 200 len: 1314 microversion: 2.1 time: 0.200190 Jun 16 18:37:45.030306 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 444/852] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:37:44 2022] GET /compute/v2.1/servers/6995a375-72a7-478f-803d-9954f14518fc => generated 1314 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:37:46.056686 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-1ee8eadb-4fea-49c3-8916-8a5fe278a4d8 tempest-VolumesActionsTest-894713622 tempest-VolumesActionsTest-894713622-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:37:46.057575 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-1ee8eadb-4fea-49c3-8916-8a5fe278a4d8 tempest-VolumesActionsTest-894713622 tempest-VolumesActionsTest-894713622-project] [instance: 6995a375-72a7-478f-803d-9954f14518fc] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:37:46.065312 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-1ee8eadb-4fea-49c3-8916-8a5fe278a4d8 tempest-VolumesActionsTest-894713622 tempest-VolumesActionsTest-894713622-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:46.065951 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-1ee8eadb-4fea-49c3-8916-8a5fe278a4d8 tempest-VolumesActionsTest-894713622 tempest-VolumesActionsTest-894713622-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:46.066752 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-1ee8eadb-4fea-49c3-8916-8a5fe278a4d8 tempest-VolumesActionsTest-894713622 tempest-VolumesActionsTest-894713622-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:46.067196 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-1ee8eadb-4fea-49c3-8916-8a5fe278a4d8 tempest-VolumesActionsTest-894713622 tempest-VolumesActionsTest-894713622-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:46.228772 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-1ee8eadb-4fea-49c3-8916-8a5fe278a4d8 tempest-VolumesActionsTest-894713622 tempest-VolumesActionsTest-894713622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ffb4685481844bc871c5b2607b5aadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4283712d27ef4a748657f3bf788ba2c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:37:46.238487 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-1ee8eadb-4fea-49c3-8916-8a5fe278a4d8 tempest-VolumesActionsTest-894713622 tempest-VolumesActionsTest-894713622-project] 10.222.0.30 "GET /compute/v2.1/servers/6995a375-72a7-478f-803d-9954f14518fc" status: 200 len: 1314 microversion: 2.1 time: 0.185714 Jun 16 18:37:46.239271 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 409/853] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:37:46 2022] GET /compute/v2.1/servers/6995a375-72a7-478f-803d-9954f14518fc => generated 1314 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:37:47.260307 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-558f5088-6001-487d-b697-0a7bd7811e1d tempest-VolumesActionsTest-894713622 tempest-VolumesActionsTest-894713622-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:37:47.261044 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-558f5088-6001-487d-b697-0a7bd7811e1d tempest-VolumesActionsTest-894713622 tempest-VolumesActionsTest-894713622-project] [instance: 6995a375-72a7-478f-803d-9954f14518fc] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:37:47.271253 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-558f5088-6001-487d-b697-0a7bd7811e1d tempest-VolumesActionsTest-894713622 tempest-VolumesActionsTest-894713622-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:47.272089 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-558f5088-6001-487d-b697-0a7bd7811e1d tempest-VolumesActionsTest-894713622 tempest-VolumesActionsTest-894713622-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:47.274082 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-558f5088-6001-487d-b697-0a7bd7811e1d tempest-VolumesActionsTest-894713622 tempest-VolumesActionsTest-894713622-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:47.274082 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-558f5088-6001-487d-b697-0a7bd7811e1d tempest-VolumesActionsTest-894713622 tempest-VolumesActionsTest-894713622-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:47.441601 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-558f5088-6001-487d-b697-0a7bd7811e1d tempest-VolumesActionsTest-894713622 tempest-VolumesActionsTest-894713622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ffb4685481844bc871c5b2607b5aadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4283712d27ef4a748657f3bf788ba2c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:37:47.450235 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-558f5088-6001-487d-b697-0a7bd7811e1d tempest-VolumesActionsTest-894713622 tempest-VolumesActionsTest-894713622-project] 10.222.0.30 "GET /compute/v2.1/servers/6995a375-72a7-478f-803d-9954f14518fc" status: 200 len: 1314 microversion: 2.1 time: 0.194692 Jun 16 18:37:47.450866 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 445/854] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:37:47 2022] GET /compute/v2.1/servers/6995a375-72a7-478f-803d-9954f14518fc => generated 1314 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:37:48.482230 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-4ae27f3a-90a2-45ea-81d0-43df87c383ba tempest-VolumesActionsTest-894713622 tempest-VolumesActionsTest-894713622-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:37:48.483474 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-4ae27f3a-90a2-45ea-81d0-43df87c383ba tempest-VolumesActionsTest-894713622 tempest-VolumesActionsTest-894713622-project] [instance: 6995a375-72a7-478f-803d-9954f14518fc] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:37:48.497220 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-4ae27f3a-90a2-45ea-81d0-43df87c383ba tempest-VolumesActionsTest-894713622 tempest-VolumesActionsTest-894713622-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:48.498182 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-4ae27f3a-90a2-45ea-81d0-43df87c383ba tempest-VolumesActionsTest-894713622 tempest-VolumesActionsTest-894713622-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:48.499759 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-4ae27f3a-90a2-45ea-81d0-43df87c383ba tempest-VolumesActionsTest-894713622 tempest-VolumesActionsTest-894713622-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:48.500655 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-4ae27f3a-90a2-45ea-81d0-43df87c383ba tempest-VolumesActionsTest-894713622 tempest-VolumesActionsTest-894713622-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:48.552409 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [req-0c5334b0-11c1-469e-90a8-3745f68f6810 req-281cd710-7dd5-47c3-817b-ebf0188309b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6995a375-72a7-478f-803d-9954f14518fc", "name": "network-vif-plugged", "status": "completed", "tag": "6d32c249-3fe4-4c57-a796-53bc6b9dd1d4"}]} {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:37:48.568447 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [req-0c5334b0-11c1-469e-90a8-3745f68f6810 req-281cd710-7dd5-47c3-817b-ebf0188309b3 service nova] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:48.569330 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [req-0c5334b0-11c1-469e-90a8-3745f68f6810 req-281cd710-7dd5-47c3-817b-ebf0188309b3 service nova] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:48.587952 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.compute.server_external_events [req-0c5334b0-11c1-469e-90a8-3745f68f6810 req-281cd710-7dd5-47c3-817b-ebf0188309b3 service nova] Creating event network-vif-plugged:6d32c249-3fe4-4c57-a796-53bc6b9dd1d4 for instance 6995a375-72a7-478f-803d-9954f14518fc on hv-cinder-81322 Jun 16 18:37:48.594523 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [req-0c5334b0-11c1-469e-90a8-3745f68f6810 req-281cd710-7dd5-47c3-817b-ebf0188309b3 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048327 Jun 16 18:37:48.595581 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 446/855] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Jun 16 18:37:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:37:48.714343 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-4ae27f3a-90a2-45ea-81d0-43df87c383ba tempest-VolumesActionsTest-894713622 tempest-VolumesActionsTest-894713622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ffb4685481844bc871c5b2607b5aadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4283712d27ef4a748657f3bf788ba2c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:37:48.724096 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-4ae27f3a-90a2-45ea-81d0-43df87c383ba tempest-VolumesActionsTest-894713622 tempest-VolumesActionsTest-894713622-project] 10.222.0.30 "GET /compute/v2.1/servers/6995a375-72a7-478f-803d-9954f14518fc" status: 200 len: 1314 microversion: 2.1 time: 0.250643 Jun 16 18:37:48.724797 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 410/856] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:37:48 2022] GET /compute/v2.1/servers/6995a375-72a7-478f-803d-9954f14518fc => generated 1314 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:37:49.746766 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-b296a144-e056-4940-8aa5-8edf332ec55e tempest-VolumesActionsTest-894713622 tempest-VolumesActionsTest-894713622-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:37:49.747501 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-b296a144-e056-4940-8aa5-8edf332ec55e tempest-VolumesActionsTest-894713622 tempest-VolumesActionsTest-894713622-project] [instance: 6995a375-72a7-478f-803d-9954f14518fc] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:37:49.749829 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG dbcounter [-] [117670] Writing DB stats nova_cell0:SELECT=2 {{(pid=117670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:49.757607 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-b296a144-e056-4940-8aa5-8edf332ec55e tempest-VolumesActionsTest-894713622 tempest-VolumesActionsTest-894713622-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:49.758137 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-b296a144-e056-4940-8aa5-8edf332ec55e tempest-VolumesActionsTest-894713622 tempest-VolumesActionsTest-894713622-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:49.758872 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-b296a144-e056-4940-8aa5-8edf332ec55e tempest-VolumesActionsTest-894713622 tempest-VolumesActionsTest-894713622-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:49.759316 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-b296a144-e056-4940-8aa5-8edf332ec55e tempest-VolumesActionsTest-894713622 tempest-VolumesActionsTest-894713622-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:49.921899 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-b296a144-e056-4940-8aa5-8edf332ec55e tempest-VolumesActionsTest-894713622 tempest-VolumesActionsTest-894713622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ffb4685481844bc871c5b2607b5aadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4283712d27ef4a748657f3bf788ba2c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:37:49.930838 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-b296a144-e056-4940-8aa5-8edf332ec55e tempest-VolumesActionsTest-894713622 tempest-VolumesActionsTest-894713622-project] 10.222.0.30 "GET /compute/v2.1/servers/6995a375-72a7-478f-803d-9954f14518fc" status: 200 len: 1314 microversion: 2.1 time: 0.188627 Jun 16 18:37:49.931427 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 447/857] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:37:49 2022] GET /compute/v2.1/servers/6995a375-72a7-478f-803d-9954f14518fc => generated 1314 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:37:50.958081 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-1404c4f9-e0f5-439f-8ee8-7beb0f44438d tempest-VolumesActionsTest-894713622 tempest-VolumesActionsTest-894713622-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:37:50.958813 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-1404c4f9-e0f5-439f-8ee8-7beb0f44438d tempest-VolumesActionsTest-894713622 tempest-VolumesActionsTest-894713622-project] [instance: 6995a375-72a7-478f-803d-9954f14518fc] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:37:50.960837 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG dbcounter [-] [117671] Writing DB stats nova_cell0:SELECT=2 {{(pid=117671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:50.961514 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG dbcounter [-] [117671] Writing DB stats nova_cell0:SELECT=6 {{(pid=117671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:37:50.968608 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-1404c4f9-e0f5-439f-8ee8-7beb0f44438d tempest-VolumesActionsTest-894713622 tempest-VolumesActionsTest-894713622-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:50.969060 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-1404c4f9-e0f5-439f-8ee8-7beb0f44438d tempest-VolumesActionsTest-894713622 tempest-VolumesActionsTest-894713622-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:50.969853 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-1404c4f9-e0f5-439f-8ee8-7beb0f44438d tempest-VolumesActionsTest-894713622 tempest-VolumesActionsTest-894713622-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:50.970290 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-1404c4f9-e0f5-439f-8ee8-7beb0f44438d tempest-VolumesActionsTest-894713622 tempest-VolumesActionsTest-894713622-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:51.129848 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-1404c4f9-e0f5-439f-8ee8-7beb0f44438d tempest-VolumesActionsTest-894713622 tempest-VolumesActionsTest-894713622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ffb4685481844bc871c5b2607b5aadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4283712d27ef4a748657f3bf788ba2c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:37:51.138605 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-1404c4f9-e0f5-439f-8ee8-7beb0f44438d tempest-VolumesActionsTest-894713622 tempest-VolumesActionsTest-894713622-project] 10.222.0.30 "GET /compute/v2.1/servers/6995a375-72a7-478f-803d-9954f14518fc" status: 200 len: 1497 microversion: 2.1 time: 0.185367 Jun 16 18:37:51.139395 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 411/858] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:37:50 2022] GET /compute/v2.1/servers/6995a375-72a7-478f-803d-9954f14518fc => generated 1497 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:37:51.664883 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-bc55116d-00ae-4964-80c3-7c2034200351 tempest-VolumesActionsTest-894713622 tempest-VolumesActionsTest-894713622-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:37:51.665476 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-bc55116d-00ae-4964-80c3-7c2034200351 tempest-VolumesActionsTest-894713622 tempest-VolumesActionsTest-894713622-project] [instance: 6995a375-72a7-478f-803d-9954f14518fc] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:37:51.674193 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-bc55116d-00ae-4964-80c3-7c2034200351 tempest-VolumesActionsTest-894713622 tempest-VolumesActionsTest-894713622-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:51.675171 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-bc55116d-00ae-4964-80c3-7c2034200351 tempest-VolumesActionsTest-894713622 tempest-VolumesActionsTest-894713622-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:51.676164 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-bc55116d-00ae-4964-80c3-7c2034200351 tempest-VolumesActionsTest-894713622 tempest-VolumesActionsTest-894713622-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:51.676760 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-bc55116d-00ae-4964-80c3-7c2034200351 tempest-VolumesActionsTest-894713622 tempest-VolumesActionsTest-894713622-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:51.707689 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-bc55116d-00ae-4964-80c3-7c2034200351 tempest-VolumesActionsTest-894713622 tempest-VolumesActionsTest-894713622-project] [instance: 6995a375-72a7-478f-803d-9954f14518fc] Going to try to terminate instance {{(pid=117670) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 18:37:51.815336 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-bc55116d-00ae-4964-80c3-7c2034200351 tempest-VolumesActionsTest-894713622 tempest-VolumesActionsTest-894713622-project] 10.222.0.30 "DELETE /compute/v2.1/servers/6995a375-72a7-478f-803d-9954f14518fc" status: 204 len: 0 microversion: 2.1 time: 0.153476 Jun 16 18:37:51.817837 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 448/859] 10.222.0.30 () {58 vars in 1238 bytes} [Thu Jun 16 18:37:51 2022] DELETE /compute/v2.1/servers/6995a375-72a7-478f-803d-9954f14518fc => generated 0 bytes in 157 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 18:37:51.828314 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-65094321-6698-41f0-afe2-81513a468886 tempest-VolumesActionsTest-894713622 tempest-VolumesActionsTest-894713622-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:37:51.828828 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-65094321-6698-41f0-afe2-81513a468886 tempest-VolumesActionsTest-894713622 tempest-VolumesActionsTest-894713622-project] [instance: 6995a375-72a7-478f-803d-9954f14518fc] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:37:51.836549 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-65094321-6698-41f0-afe2-81513a468886 tempest-VolumesActionsTest-894713622 tempest-VolumesActionsTest-894713622-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:51.837140 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-65094321-6698-41f0-afe2-81513a468886 tempest-VolumesActionsTest-894713622 tempest-VolumesActionsTest-894713622-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:51.838036 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-65094321-6698-41f0-afe2-81513a468886 tempest-VolumesActionsTest-894713622 tempest-VolumesActionsTest-894713622-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:51.838592 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-65094321-6698-41f0-afe2-81513a468886 tempest-VolumesActionsTest-894713622 tempest-VolumesActionsTest-894713622-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:52.006992 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-65094321-6698-41f0-afe2-81513a468886 tempest-VolumesActionsTest-894713622 tempest-VolumesActionsTest-894713622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ffb4685481844bc871c5b2607b5aadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4283712d27ef4a748657f3bf788ba2c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:37:52.017075 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-65094321-6698-41f0-afe2-81513a468886 tempest-VolumesActionsTest-894713622 tempest-VolumesActionsTest-894713622-project] 10.222.0.30 "GET /compute/v2.1/servers/6995a375-72a7-478f-803d-9954f14518fc" status: 200 len: 1503 microversion: 2.1 time: 0.193790 Jun 16 18:37:52.019174 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 412/860] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:37:51 2022] GET /compute/v2.1/servers/6995a375-72a7-478f-803d-9954f14518fc => generated 1503 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:37:53.038088 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-ed8e20b1-fabc-41ea-981c-2d8d0eb3dd14 tempest-VolumesActionsTest-894713622 tempest-VolumesActionsTest-894713622-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:37:53.039095 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-ed8e20b1-fabc-41ea-981c-2d8d0eb3dd14 tempest-VolumesActionsTest-894713622 tempest-VolumesActionsTest-894713622-project] [instance: 6995a375-72a7-478f-803d-9954f14518fc] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:37:53.046481 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-ed8e20b1-fabc-41ea-981c-2d8d0eb3dd14 tempest-VolumesActionsTest-894713622 tempest-VolumesActionsTest-894713622-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:53.046929 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-ed8e20b1-fabc-41ea-981c-2d8d0eb3dd14 tempest-VolumesActionsTest-894713622 tempest-VolumesActionsTest-894713622-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:53.047719 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-ed8e20b1-fabc-41ea-981c-2d8d0eb3dd14 tempest-VolumesActionsTest-894713622 tempest-VolumesActionsTest-894713622-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:53.048263 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-ed8e20b1-fabc-41ea-981c-2d8d0eb3dd14 tempest-VolumesActionsTest-894713622 tempest-VolumesActionsTest-894713622-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:53.206678 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-ed8e20b1-fabc-41ea-981c-2d8d0eb3dd14 tempest-VolumesActionsTest-894713622 tempest-VolumesActionsTest-894713622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ffb4685481844bc871c5b2607b5aadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4283712d27ef4a748657f3bf788ba2c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:37:53.215016 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-ed8e20b1-fabc-41ea-981c-2d8d0eb3dd14 tempest-VolumesActionsTest-894713622 tempest-VolumesActionsTest-894713622-project] 10.222.0.30 "GET /compute/v2.1/servers/6995a375-72a7-478f-803d-9954f14518fc" status: 200 len: 1503 microversion: 2.1 time: 0.181853 Jun 16 18:37:53.215622 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 449/861] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:37:53 2022] GET /compute/v2.1/servers/6995a375-72a7-478f-803d-9954f14518fc => generated 1503 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:37:53.884794 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [req-84540914-97a0-4d80-b0a8-d73ec372ad86 req-c7076620-9f80-4e8c-9a9e-42ae60325041 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6995a375-72a7-478f-803d-9954f14518fc", "name": "network-vif-deleted", "tag": "6d32c249-3fe4-4c57-a796-53bc6b9dd1d4"}]} {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:37:53.895961 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [req-84540914-97a0-4d80-b0a8-d73ec372ad86 req-c7076620-9f80-4e8c-9a9e-42ae60325041 service nova] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:53.896453 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [req-84540914-97a0-4d80-b0a8-d73ec372ad86 req-c7076620-9f80-4e8c-9a9e-42ae60325041 service nova] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:53.911278 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.compute.server_external_events [req-84540914-97a0-4d80-b0a8-d73ec372ad86 req-c7076620-9f80-4e8c-9a9e-42ae60325041 service nova] Creating event network-vif-deleted:6d32c249-3fe4-4c57-a796-53bc6b9dd1d4 for instance 6995a375-72a7-478f-803d-9954f14518fc on hv-cinder-81322 Jun 16 18:37:53.917213 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [req-84540914-97a0-4d80-b0a8-d73ec372ad86 req-c7076620-9f80-4e8c-9a9e-42ae60325041 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036367 Jun 16 18:37:53.918394 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 413/862] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Jun 16 18:37:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 18:37:54.234926 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-1d18e3e9-0f80-4c34-9fe6-6ab669db7bd4 tempest-VolumesActionsTest-894713622 tempest-VolumesActionsTest-894713622-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:37:54.235659 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-1d18e3e9-0f80-4c34-9fe6-6ab669db7bd4 tempest-VolumesActionsTest-894713622 tempest-VolumesActionsTest-894713622-project] [instance: 6995a375-72a7-478f-803d-9954f14518fc] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:37:54.243774 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-1d18e3e9-0f80-4c34-9fe6-6ab669db7bd4 tempest-VolumesActionsTest-894713622 tempest-VolumesActionsTest-894713622-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:54.244192 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-1d18e3e9-0f80-4c34-9fe6-6ab669db7bd4 tempest-VolumesActionsTest-894713622 tempest-VolumesActionsTest-894713622-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:54.245086 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-1d18e3e9-0f80-4c34-9fe6-6ab669db7bd4 tempest-VolumesActionsTest-894713622 tempest-VolumesActionsTest-894713622-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:54.245530 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-1d18e3e9-0f80-4c34-9fe6-6ab669db7bd4 tempest-VolumesActionsTest-894713622 tempest-VolumesActionsTest-894713622-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:54.288367 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-1d18e3e9-0f80-4c34-9fe6-6ab669db7bd4 tempest-VolumesActionsTest-894713622 tempest-VolumesActionsTest-894713622-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:54.288867 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-1d18e3e9-0f80-4c34-9fe6-6ab669db7bd4 tempest-VolumesActionsTest-894713622 tempest-VolumesActionsTest-894713622-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:54.289392 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.objects.instance [None req-1d18e3e9-0f80-4c34-9fe6-6ab669db7bd4 tempest-VolumesActionsTest-894713622 tempest-VolumesActionsTest-894713622-project] Lazy-loading 'fault' on Instance uuid 6995a375-72a7-478f-803d-9954f14518fc {{(pid=117670) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 18:37:54.340971 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-1d18e3e9-0f80-4c34-9fe6-6ab669db7bd4 tempest-VolumesActionsTest-894713622 tempest-VolumesActionsTest-894713622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ffb4685481844bc871c5b2607b5aadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4283712d27ef4a748657f3bf788ba2c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:37:54.354916 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-1d18e3e9-0f80-4c34-9fe6-6ab669db7bd4 tempest-VolumesActionsTest-894713622 tempest-VolumesActionsTest-894713622-project] 10.222.0.30 "GET /compute/v2.1/servers/6995a375-72a7-478f-803d-9954f14518fc" status: 200 len: 1304 microversion: 2.1 time: 0.123781 Jun 16 18:37:54.355863 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 450/863] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:37:54 2022] GET /compute/v2.1/servers/6995a375-72a7-478f-803d-9954f14518fc => generated 1304 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:37:55.379630 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-aad57781-668f-475d-af50-627727b9bd8b tempest-VolumesActionsTest-894713622 tempest-VolumesActionsTest-894713622-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:37:55.380482 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-aad57781-668f-475d-af50-627727b9bd8b tempest-VolumesActionsTest-894713622 tempest-VolumesActionsTest-894713622-project] [instance: 6995a375-72a7-478f-803d-9954f14518fc] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:37:55.388014 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-aad57781-668f-475d-af50-627727b9bd8b tempest-VolumesActionsTest-894713622 tempest-VolumesActionsTest-894713622-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:55.388651 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-aad57781-668f-475d-af50-627727b9bd8b tempest-VolumesActionsTest-894713622 tempest-VolumesActionsTest-894713622-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:55.389512 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-aad57781-668f-475d-af50-627727b9bd8b tempest-VolumesActionsTest-894713622 tempest-VolumesActionsTest-894713622-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:37:55.389949 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-aad57781-668f-475d-af50-627727b9bd8b tempest-VolumesActionsTest-894713622 tempest-VolumesActionsTest-894713622-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:37:55.405837 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.wsgi [None req-aad57781-668f-475d-af50-627727b9bd8b tempest-VolumesActionsTest-894713622 tempest-VolumesActionsTest-894713622-project] HTTP exception thrown: Instance 6995a375-72a7-478f-803d-9954f14518fc could not be found. Jun 16 18:37:55.407530 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-aad57781-668f-475d-af50-627727b9bd8b tempest-VolumesActionsTest-894713622 tempest-VolumesActionsTest-894713622-project] Request method failure captured: Jun 16 18:37:55.407530 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: request: GET /compute/v2.1/servers/6995a375-72a7-478f-803d-9954f14518fc HTTP/1.1 Jun 16 18:37:55.407530 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: Accept: application/json Jun 16 18:37:55.407530 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: Accept-Encoding: identity Jun 16 18:37:55.407530 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: Connection: close Jun 16 18:37:55.407530 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: Content-Length: 0 Jun 16 18:37:55.407530 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: Content-Type: application/json Jun 16 18:37:55.407530 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: Host: 10.222.0.30 Jun 16 18:37:55.407530 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: Openstack-System-Scope: None Jun 16 18:37:55.407530 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: User-Agent: python-urllib3/1.26.9 Jun 16 18:37:55.407530 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Auth-Token: gAAAAABiq3hdeMw4Cm6gBPNmBBkBgCZN6hv8kJ7wWtW8kxJjdCog7Y8wcX6SXXIw9K-IA0mJxWUEzWdh15sjcopLKUS5nj9mJurGbzb8GUGt5FYbBM0EUJ6CFeVFt743UuqrlhgHRx57kff9CgjzcJ-BTL1pzHgbBiOcJ-mFJdxOLe9MtNsZdCI Jun 16 18:37:55.407530 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Domain-Id: None Jun 16 18:37:55.407530 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Domain-Name: None Jun 16 18:37:55.407530 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Identity-Status: Confirmed Jun 16 18:37:55.407530 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Is-Admin-Project: True Jun 16 18:37:55.407530 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Project-Domain-Id: default Jun 16 18:37:55.407530 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Project-Domain-Name: Default Jun 16 18:37:55.407530 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Project-Id: 4283712d27ef4a748657f3bf788ba2c7 Jun 16 18:37:55.407530 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Project-Name: tempest-VolumesActionsTest-894713622 Jun 16 18:37:55.407530 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Role: reader,member Jun 16 18:37:55.407530 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Roles: reader,member Jun 16 18:37:55.410569 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/4283712d27ef4a748657f3bf788ba2c7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/4283712d27ef4a748657f3bf788ba2c7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_4283712d27ef4a748657f3bf788ba2c7", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/4283712d27ef4a748657f3bf788ba2c7"}]}] Jun 16 18:37:55.410569 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Tenant: tempest-VolumesActionsTest-894713622 Jun 16 18:37:55.410569 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Tenant-Id: 4283712d27ef4a748657f3bf788ba2c7 Jun 16 18:37:55.410569 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Tenant-Name: tempest-VolumesActionsTest-894713622 Jun 16 18:37:55.410569 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-User: tempest-VolumesActionsTest-894713622-project Jun 16 18:37:55.410569 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-User-Domain-Id: default Jun 16 18:37:55.410569 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-User-Domain-Name: Default Jun 16 18:37:55.410569 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-User-Id: 5ffb4685481844bc871c5b2607b5aadb Jun 16 18:37:55.410569 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-User-Name: tempest-VolumesActionsTest-894713622-project Jun 16 18:37:55.410569 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: method: > Jun 16 18:37:55.410569 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: exception: Instance 6995a375-72a7-478f-803d-9954f14518fc could not be found. Jun 16 18:37:55.410569 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: action_args: {'id': '6995a375-72a7-478f-803d-9954f14518fc'} Jun 16 18:37:55.411771 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:37:55.411771 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:37:55.411771 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 18:37:55.411771 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 18:37:55.411771 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 18:37:55.411771 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 18:37:55.411771 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 18:37:55.411771 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 18:37:55.411771 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 18:37:55.411771 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 18:37:55.411771 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6995a375-72a7-478f-803d-9954f14518fc could not be found. Jun 16 18:37:55.411771 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Jun 16 18:37:55.411771 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:37:55.411771 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Jun 16 18:37:55.411771 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:37:55.411771 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:37:55.411771 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:37:55.411771 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:37:55.411771 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:37:55.411771 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:37:55.414006 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:37:55.414006 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 18:37:55.414006 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 18:37:55.414006 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 18:37:55.414006 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 18:37:55.414006 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 18:37:55.414006 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:37:55.414006 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6995a375-72a7-478f-803d-9954f14518fc could not be found. Jun 16 18:37:55.414006 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Jun 16 18:37:55.414006 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:37:55.414006 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Jun 16 18:37:55.414006 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:37:55.414006 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:37:55.414006 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:37:55.414006 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:37:55.414006 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:37:55.414006 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6995a375-72a7-478f-803d-9954f14518fc could not be found. Jun 16 18:37:55.414006 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Jun 16 18:37:55.416626 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-aad57781-668f-475d-af50-627727b9bd8b tempest-VolumesActionsTest-894713622 tempest-VolumesActionsTest-894713622-project] Returning 404 to user: Instance 6995a375-72a7-478f-803d-9954f14518fc could not be found. {{(pid=117671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:37:55.416626 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-aad57781-668f-475d-af50-627727b9bd8b tempest-VolumesActionsTest-894713622 tempest-VolumesActionsTest-894713622-project] 10.222.0.30 "GET /compute/v2.1/servers/6995a375-72a7-478f-803d-9954f14518fc" status: 404 len: 111 microversion: 2.1 time: 0.035672 Jun 16 18:37:55.416626 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 414/864] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:37:55 2022] GET /compute/v2.1/servers/6995a375-72a7-478f-803d-9954f14518fc => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:38:00.396012 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-23ef928a-aea9-4501-a79c-c68cd548f508 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:38:00.397678 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-23ef928a-aea9-4501-a79c-c68cd548f508 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] [instance: f116c8d4-a63e-47e1-bb50-ec64f735bfcc] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:38:00.401431 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG dbcounter [-] [117670] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=1 {{(pid=117670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:00.411870 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-23ef928a-aea9-4501-a79c-c68cd548f508 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:00.413149 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-23ef928a-aea9-4501-a79c-c68cd548f508 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:00.414256 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-23ef928a-aea9-4501-a79c-c68cd548f508 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:00.414923 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-23ef928a-aea9-4501-a79c-c68cd548f508 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:00.472674 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-23ef928a-aea9-4501-a79c-c68cd548f508 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] 10.222.0.30 "GET /compute/v2.1/servers/f116c8d4-a63e-47e1-bb50-ec64f735bfcc/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.083246 Jun 16 18:38:00.473958 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 451/865] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Jun 16 18:38:00 2022] GET /compute/v2.1/servers/f116c8d4-a63e-47e1-bb50-ec64f735bfcc/os-volume_attachments => generated 25 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 16 18:38:00.601962 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-f8573818-d48b-4b29-8bc7-00caa3519977 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:38:00.602620 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-f8573818-d48b-4b29-8bc7-00caa3519977 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] [instance: f116c8d4-a63e-47e1-bb50-ec64f735bfcc] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:38:00.605376 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG dbcounter [-] [117671] Writing DB stats nova_api:SELECT=58,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=117671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:00.615106 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-f8573818-d48b-4b29-8bc7-00caa3519977 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:00.615606 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-f8573818-d48b-4b29-8bc7-00caa3519977 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:00.616433 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-f8573818-d48b-4b29-8bc7-00caa3519977 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:00.616870 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-f8573818-d48b-4b29-8bc7-00caa3519977 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:00.651701 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-f8573818-d48b-4b29-8bc7-00caa3519977 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] [instance: f116c8d4-a63e-47e1-bb50-ec64f735bfcc] Going to try to terminate instance {{(pid=117671) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 18:38:00.765818 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-f8573818-d48b-4b29-8bc7-00caa3519977 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] 10.222.0.30 "DELETE /compute/v2.1/servers/f116c8d4-a63e-47e1-bb50-ec64f735bfcc" status: 204 len: 0 microversion: 2.1 time: 0.167236 Jun 16 18:38:00.766996 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 415/866] 10.222.0.30 () {58 vars in 1238 bytes} [Thu Jun 16 18:38:00 2022] DELETE /compute/v2.1/servers/f116c8d4-a63e-47e1-bb50-ec64f735bfcc => generated 0 bytes in 172 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 18:38:00.777545 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-2e6982aa-421f-46d3-8acf-216fff4299bc tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:38:00.778368 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-2e6982aa-421f-46d3-8acf-216fff4299bc tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] [instance: f116c8d4-a63e-47e1-bb50-ec64f735bfcc] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:38:00.787503 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-2e6982aa-421f-46d3-8acf-216fff4299bc tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:00.788933 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-2e6982aa-421f-46d3-8acf-216fff4299bc tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:00.790222 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-2e6982aa-421f-46d3-8acf-216fff4299bc tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:00.790956 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-2e6982aa-421f-46d3-8acf-216fff4299bc tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:01.060512 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-2e6982aa-421f-46d3-8acf-216fff4299bc tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebdf8e3cd1b44dcba37cdcfb4af7db2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a8e1d26bdfc400ebd1e070b09db615e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:38:01.070812 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG dbcounter [-] [117670] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:01.081678 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-2e6982aa-421f-46d3-8acf-216fff4299bc tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] 10.222.0.30 "GET /compute/v2.1/servers/f116c8d4-a63e-47e1-bb50-ec64f735bfcc" status: 200 len: 1673 microversion: 2.1 time: 0.308966 Jun 16 18:38:01.082614 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 452/867] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:38:00 2022] GET /compute/v2.1/servers/f116c8d4-a63e-47e1-bb50-ec64f735bfcc => generated 1673 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:38:02.107353 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-0ffc8697-8750-4242-8f35-a2ccf02cd053 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:38:02.108732 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-0ffc8697-8750-4242-8f35-a2ccf02cd053 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] [instance: f116c8d4-a63e-47e1-bb50-ec64f735bfcc] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:38:02.119572 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-0ffc8697-8750-4242-8f35-a2ccf02cd053 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:02.120200 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-0ffc8697-8750-4242-8f35-a2ccf02cd053 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:02.121134 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-0ffc8697-8750-4242-8f35-a2ccf02cd053 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:02.121576 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-0ffc8697-8750-4242-8f35-a2ccf02cd053 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:02.332975 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-0ffc8697-8750-4242-8f35-a2ccf02cd053 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebdf8e3cd1b44dcba37cdcfb4af7db2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a8e1d26bdfc400ebd1e070b09db615e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:38:02.347162 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-0ffc8697-8750-4242-8f35-a2ccf02cd053 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] 10.222.0.30 "GET /compute/v2.1/servers/f116c8d4-a63e-47e1-bb50-ec64f735bfcc" status: 200 len: 1673 microversion: 2.1 time: 0.247922 Jun 16 18:38:02.348851 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 416/868] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:38:02 2022] GET /compute/v2.1/servers/f116c8d4-a63e-47e1-bb50-ec64f735bfcc => generated 1673 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:38:03.375017 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-46996136-a328-4ca8-b62a-4b5b20b9f01d tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:38:03.376176 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-46996136-a328-4ca8-b62a-4b5b20b9f01d tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] [instance: f116c8d4-a63e-47e1-bb50-ec64f735bfcc] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:38:03.390616 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-46996136-a328-4ca8-b62a-4b5b20b9f01d tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:03.391630 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-46996136-a328-4ca8-b62a-4b5b20b9f01d tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:03.393074 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-46996136-a328-4ca8-b62a-4b5b20b9f01d tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:03.393292 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-46996136-a328-4ca8-b62a-4b5b20b9f01d tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:03.689510 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-46996136-a328-4ca8-b62a-4b5b20b9f01d tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebdf8e3cd1b44dcba37cdcfb4af7db2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a8e1d26bdfc400ebd1e070b09db615e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:38:03.703352 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-46996136-a328-4ca8-b62a-4b5b20b9f01d tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] 10.222.0.30 "GET /compute/v2.1/servers/f116c8d4-a63e-47e1-bb50-ec64f735bfcc" status: 200 len: 1673 microversion: 2.1 time: 0.334997 Jun 16 18:38:03.704221 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 453/869] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:38:03 2022] GET /compute/v2.1/servers/f116c8d4-a63e-47e1-bb50-ec64f735bfcc => generated 1673 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:38:04.748892 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-b58d3c48-3846-432b-b675-2e3bbcb00e28 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:38:04.750917 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-b58d3c48-3846-432b-b675-2e3bbcb00e28 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] [instance: f116c8d4-a63e-47e1-bb50-ec64f735bfcc] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:38:04.783272 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-b58d3c48-3846-432b-b675-2e3bbcb00e28 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:04.784506 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-b58d3c48-3846-432b-b675-2e3bbcb00e28 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:04.785514 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-b58d3c48-3846-432b-b675-2e3bbcb00e28 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:04.786184 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-b58d3c48-3846-432b-b675-2e3bbcb00e28 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:05.207748 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [req-e0b2b65e-f2ae-4bbe-87ff-540585a04afc req-63fc3886-6216-4e16-88de-7806a61d4fb7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f116c8d4-a63e-47e1-bb50-ec64f735bfcc", "name": "network-vif-deleted", "tag": "897c17d5-5664-4330-a940-38c13c304dca"}]} {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:38:05.208743 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-b58d3c48-3846-432b-b675-2e3bbcb00e28 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebdf8e3cd1b44dcba37cdcfb4af7db2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a8e1d26bdfc400ebd1e070b09db615e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:38:05.220036 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [req-e0b2b65e-f2ae-4bbe-87ff-540585a04afc req-63fc3886-6216-4e16-88de-7806a61d4fb7 service nova] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:05.220755 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [req-e0b2b65e-f2ae-4bbe-87ff-540585a04afc req-63fc3886-6216-4e16-88de-7806a61d4fb7 service nova] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:05.234156 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-b58d3c48-3846-432b-b675-2e3bbcb00e28 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] 10.222.0.30 "GET /compute/v2.1/servers/f116c8d4-a63e-47e1-bb50-ec64f735bfcc" status: 200 len: 1606 microversion: 2.1 time: 0.509844 Jun 16 18:38:05.235205 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.compute.server_external_events [req-e0b2b65e-f2ae-4bbe-87ff-540585a04afc req-63fc3886-6216-4e16-88de-7806a61d4fb7 service nova] Creating event network-vif-deleted:897c17d5-5664-4330-a940-38c13c304dca for instance f116c8d4-a63e-47e1-bb50-ec64f735bfcc on hv-cinder-81322 Jun 16 18:38:05.253825 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 417/870] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:38:04 2022] GET /compute/v2.1/servers/f116c8d4-a63e-47e1-bb50-ec64f735bfcc => generated 1606 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:38:05.256090 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [req-e0b2b65e-f2ae-4bbe-87ff-540585a04afc req-63fc3886-6216-4e16-88de-7806a61d4fb7 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052636 Jun 16 18:38:05.257536 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 454/871] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Jun 16 18:38:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:38:06.257031 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-74d94fc0-217f-48fc-888f-41812cd4fecb tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:38:06.257779 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-74d94fc0-217f-48fc-888f-41812cd4fecb tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] [instance: f116c8d4-a63e-47e1-bb50-ec64f735bfcc] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:38:06.268696 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-74d94fc0-217f-48fc-888f-41812cd4fecb tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:06.269837 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-74d94fc0-217f-48fc-888f-41812cd4fecb tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:06.271245 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-74d94fc0-217f-48fc-888f-41812cd4fecb tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:06.272168 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-74d94fc0-217f-48fc-888f-41812cd4fecb tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:06.288207 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG dbcounter [-] [117671] Writing DB stats nova_cell1:SELECT=83,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:06.290233 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.wsgi [None req-74d94fc0-217f-48fc-888f-41812cd4fecb tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] HTTP exception thrown: Instance f116c8d4-a63e-47e1-bb50-ec64f735bfcc could not be found. Jun 16 18:38:06.292320 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-74d94fc0-217f-48fc-888f-41812cd4fecb tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Request method failure captured: Jun 16 18:38:06.292320 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: request: GET /compute/v2.1/servers/f116c8d4-a63e-47e1-bb50-ec64f735bfcc HTTP/1.1 Jun 16 18:38:06.292320 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: Accept: application/json Jun 16 18:38:06.292320 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: Accept-Encoding: identity Jun 16 18:38:06.292320 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: Connection: close Jun 16 18:38:06.292320 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: Content-Length: 0 Jun 16 18:38:06.292320 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: Content-Type: application/json Jun 16 18:38:06.292320 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: Host: 10.222.0.30 Jun 16 18:38:06.292320 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: Openstack-System-Scope: None Jun 16 18:38:06.292320 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: User-Agent: python-urllib3/1.26.9 Jun 16 18:38:06.292320 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Auth-Token: gAAAAABiq3fCz_lfdO6bJNVO6BOUMdUJyD_mDnYFsrflkHu2X7_Q_EE66ihB233_CJeGX8VeIovBK-MdwX4QnFKy23zv0WlNnIm8wFu8aqA7k6kwZzdk_c6z39uXG3xWbYZzS3JBkESQwGgbmehb8LkLgx_C5HLfG3l93SCRo2fsRfSw5uj1YFM Jun 16 18:38:06.292320 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Domain-Id: None Jun 16 18:38:06.292320 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Domain-Name: None Jun 16 18:38:06.292320 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Identity-Status: Confirmed Jun 16 18:38:06.292320 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Is-Admin-Project: True Jun 16 18:38:06.292320 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Project-Domain-Id: default Jun 16 18:38:06.292320 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Project-Domain-Name: Default Jun 16 18:38:06.292320 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Project-Id: 7a8e1d26bdfc400ebd1e070b09db615e Jun 16 18:38:06.292320 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Project-Name: tempest-AttachVolumeTestJSON-1372713651 Jun 16 18:38:06.292320 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Role: reader,member Jun 16 18:38:06.292320 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Roles: reader,member Jun 16 18:38:06.294067 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/7a8e1d26bdfc400ebd1e070b09db615e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/7a8e1d26bdfc400ebd1e070b09db615e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_7a8e1d26bdfc400ebd1e070b09db615e", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/7a8e1d26bdfc400ebd1e070b09db615e"}]}] Jun 16 18:38:06.294067 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Tenant: tempest-AttachVolumeTestJSON-1372713651 Jun 16 18:38:06.294067 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Tenant-Id: 7a8e1d26bdfc400ebd1e070b09db615e Jun 16 18:38:06.294067 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1372713651 Jun 16 18:38:06.294067 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-User: tempest-AttachVolumeTestJSON-1372713651-project Jun 16 18:38:06.294067 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-User-Domain-Id: default Jun 16 18:38:06.294067 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-User-Domain-Name: Default Jun 16 18:38:06.294067 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-User-Id: ebdf8e3cd1b44dcba37cdcfb4af7db2b Jun 16 18:38:06.294067 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-User-Name: tempest-AttachVolumeTestJSON-1372713651-project Jun 16 18:38:06.294067 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: method: > Jun 16 18:38:06.294067 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: exception: Instance f116c8d4-a63e-47e1-bb50-ec64f735bfcc could not be found. Jun 16 18:38:06.294067 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: action_args: {'id': 'f116c8d4-a63e-47e1-bb50-ec64f735bfcc'} Jun 16 18:38:06.295125 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:38:06.295125 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:38:06.295125 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 18:38:06.295125 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 18:38:06.295125 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 18:38:06.295125 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 18:38:06.295125 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 18:38:06.295125 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 18:38:06.295125 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 18:38:06.295125 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 18:38:06.295125 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f116c8d4-a63e-47e1-bb50-ec64f735bfcc could not be found. Jun 16 18:38:06.295125 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Jun 16 18:38:06.295125 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:38:06.295125 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Jun 16 18:38:06.295125 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:38:06.295125 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:38:06.295125 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:38:06.295125 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:38:06.295125 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:38:06.295125 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:38:06.296641 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:38:06.296641 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 18:38:06.296641 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 18:38:06.296641 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 18:38:06.296641 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 18:38:06.296641 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 18:38:06.296641 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:38:06.296641 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f116c8d4-a63e-47e1-bb50-ec64f735bfcc could not be found. Jun 16 18:38:06.296641 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Jun 16 18:38:06.296641 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:38:06.296641 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Jun 16 18:38:06.296641 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:38:06.296641 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:38:06.296641 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:38:06.296641 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:38:06.296641 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:38:06.296641 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f116c8d4-a63e-47e1-bb50-ec64f735bfcc could not be found. Jun 16 18:38:06.296641 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Jun 16 18:38:06.300211 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-74d94fc0-217f-48fc-888f-41812cd4fecb tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Returning 404 to user: Instance f116c8d4-a63e-47e1-bb50-ec64f735bfcc could not be found. {{(pid=117671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:38:06.301577 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-74d94fc0-217f-48fc-888f-41812cd4fecb tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] 10.222.0.30 "GET /compute/v2.1/servers/f116c8d4-a63e-47e1-bb50-ec64f735bfcc" status: 404 len: 111 microversion: 2.1 time: 0.050521 Jun 16 18:38:06.302802 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 418/872] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:38:06 2022] GET /compute/v2.1/servers/f116c8d4-a63e-47e1-bb50-ec64f735bfcc => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 16 18:38:06.312722 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-d36c966f-cbc7-4288-919b-7916ae27129b tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Calling method '.version_select at 0x7fbb34656310>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:38:06.317815 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR oslo.messaging._drivers.impl_rabbit [None req-d36c966f-cbc7-4288-919b-7916ae27129b tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] [e2a16d99-2966-4afd-92d1-7fb26b0bb670] AMQP server on 10.222.0.30:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 16 18:38:07.329514 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO oslo.messaging._drivers.impl_rabbit [None req-d36c966f-cbc7-4288-919b-7916ae27129b tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] [e2a16d99-2966-4afd-92d1-7fb26b0bb670] Reconnected to AMQP server on 10.222.0.30:5672 via [amqp] client with port 55904. Jun 16 18:38:07.359326 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-d36c966f-cbc7-4288-919b-7916ae27129b tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1285075105" status: 202 len: 0 microversion: 2.1 time: 1.051299 Jun 16 18:38:07.365563 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 455/873] 10.222.0.30 () {58 vars in 1220 bytes} [Thu Jun 16 18:38:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1285075105 => generated 0 bytes in 1059 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 18:38:08.608375 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-02897f70-07c3-4f7d-a8c6-3032c10f1101 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Action: 'create', calling method: .version_select at 0x7fbb23e2c160>, body: {"keypair": {"name": "tempest-keypair-454788496", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBF3NLn3M2OXsFBfF15L4Mo+jsf5opZ2yu4b1Kk9moCq6fkBoGVP1FpBJLmkyhZmPmFDmdYFFNLy+1msTHNjjTndCO3DVH0dV/4yuVlckJzbsagJ/ZHLoOzdeCIayzoajQ=="}} {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:38:08.631719 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.quota [None req-02897f70-07c3-4f7d-a8c6-3032c10f1101 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Getting quotas for project 7a8e1d26bdfc400ebd1e070b09db615e. Resources: {'key_pairs'} {{(pid=117671) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 18:38:08.641721 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.quota [None req-02897f70-07c3-4f7d-a8c6-3032c10f1101 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Getting quotas for user ebdf8e3cd1b44dcba37cdcfb4af7db2b and project 7a8e1d26bdfc400ebd1e070b09db615e. Resources: {'key_pairs'} {{(pid=117671) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 18:38:08.707436 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-02897f70-07c3-4f7d-a8c6-3032c10f1101 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.106079 Jun 16 18:38:08.708955 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 419/874] 10.222.0.30 () {60 vars in 1158 bytes} [Thu Jun 16 18:38:08 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:38:11.281423 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-3f9bbc23-331b-41b8-9070-ce93cf16d129 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1739468256", "imageRef": "38ef083a-a9ff-4836-8954-f770268ba205", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4c5d81c9-e546-4ae0-bf8f-e3bb9c16e4e0"}], "security_groups": [{"name": "tempest-securitygroup--519449768"}], "key_name": "tempest-keypair-454788496", "user_data": "}} {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:38:11.443268 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.network.neutron [None req-3f9bbc23-331b-41b8-9070-ce93cf16d129 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] validate_networks() for [('4c5d81c9-e546-4ae0-bf8f-e3bb9c16e4e0', None, None, None, None, None)] {{(pid=117670) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 18:38:12.542499 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.virt.hardware [None req-3f9bbc23-331b-41b8-9070-ce93cf16d129 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Flavor limits 0:0:0 {{(pid=117670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 18:38:12.544775 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.virt.hardware [None req-3f9bbc23-331b-41b8-9070-ce93cf16d129 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Image limits 0:0:0 {{(pid=117670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 18:38:12.545712 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.virt.hardware [None req-3f9bbc23-331b-41b8-9070-ce93cf16d129 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Flavor pref 0:0:0 {{(pid=117670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 18:38:12.546496 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.virt.hardware [None req-3f9bbc23-331b-41b8-9070-ce93cf16d129 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Image pref 0:0:0 {{(pid=117670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 18:38:12.547072 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.virt.hardware [None req-3f9bbc23-331b-41b8-9070-ce93cf16d129 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 18:38:12.578905 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-3f9bbc23-331b-41b8-9070-ce93cf16d129 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:12.581356 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-3f9bbc23-331b-41b8-9070-ce93cf16d129 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:12.582367 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-3f9bbc23-331b-41b8-9070-ce93cf16d129 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:12.585187 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-3f9bbc23-331b-41b8-9070-ce93cf16d129 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:12.619818 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.quota [None req-3f9bbc23-331b-41b8-9070-ce93cf16d129 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Getting quotas for project 7a8e1d26bdfc400ebd1e070b09db615e. Resources: {'instances', 'ram', 'cores'} {{(pid=117670) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 18:38:12.628249 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.quota [None req-3f9bbc23-331b-41b8-9070-ce93cf16d129 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Getting quotas for user ebdf8e3cd1b44dcba37cdcfb4af7db2b and project 7a8e1d26bdfc400ebd1e070b09db615e. Resources: {'instances', 'ram', 'cores'} {{(pid=117670) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 18:38:12.648718 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-3f9bbc23-331b-41b8-9070-ce93cf16d129 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Going to run 1 instances... {{(pid=117670) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 18:38:12.653247 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-3f9bbc23-331b-41b8-9070-ce93cf16d129 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] [instance: 476fd575-4b38-4ab0-aa32-b7ea9f67c0ff] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='38ef083a-a9ff-4836-8954-f770268ba205',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117670) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 18:38:12.754783 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-3f9bbc23-331b-41b8-9070-ce93cf16d129 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.477818 Jun 16 18:38:12.755895 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 456/875] 10.222.0.30 () {60 vars in 1146 bytes} [Thu Jun 16 18:38:11 2022] POST /compute/v2.1/servers => generated 401 bytes in 1480 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 16 18:38:12.767632 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-a03ea7b6-5dad-46bf-bc49-beb9429aaf44 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:38:12.769200 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-a03ea7b6-5dad-46bf-bc49-beb9429aaf44 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] [instance: 476fd575-4b38-4ab0-aa32-b7ea9f67c0ff] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:38:12.886127 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-a03ea7b6-5dad-46bf-bc49-beb9429aaf44 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebdf8e3cd1b44dcba37cdcfb4af7db2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a8e1d26bdfc400ebd1e070b09db615e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:38:12.902365 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-a03ea7b6-5dad-46bf-bc49-beb9429aaf44 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] 10.222.0.30 "GET /compute/v2.1/servers/476fd575-4b38-4ab0-aa32-b7ea9f67c0ff" status: 200 len: 1237 microversion: 2.1 time: 0.137402 Jun 16 18:38:12.903716 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 420/876] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:38:12 2022] GET /compute/v2.1/servers/476fd575-4b38-4ab0-aa32-b7ea9f67c0ff => generated 1237 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:38:13.931391 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-e332eb14-8d15-45d9-9896-0226c52a125f tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:38:13.933034 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-e332eb14-8d15-45d9-9896-0226c52a125f tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] [instance: 476fd575-4b38-4ab0-aa32-b7ea9f67c0ff] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:38:13.948404 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-e332eb14-8d15-45d9-9896-0226c52a125f tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:13.949239 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-e332eb14-8d15-45d9-9896-0226c52a125f tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:13.950856 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-e332eb14-8d15-45d9-9896-0226c52a125f tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:13.951953 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-e332eb14-8d15-45d9-9896-0226c52a125f tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:14.078781 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-e332eb14-8d15-45d9-9896-0226c52a125f tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebdf8e3cd1b44dcba37cdcfb4af7db2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a8e1d26bdfc400ebd1e070b09db615e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:38:14.094142 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-e332eb14-8d15-45d9-9896-0226c52a125f tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] 10.222.0.30 "GET /compute/v2.1/servers/476fd575-4b38-4ab0-aa32-b7ea9f67c0ff" status: 200 len: 1289 microversion: 2.1 time: 0.173890 Jun 16 18:38:14.102446 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 457/877] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:38:13 2022] GET /compute/v2.1/servers/476fd575-4b38-4ab0-aa32-b7ea9f67c0ff => generated 1289 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:38:15.125129 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-370f1265-efe1-4ed5-b8b6-d6489401a8f2 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:38:15.128012 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-370f1265-efe1-4ed5-b8b6-d6489401a8f2 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] [instance: 476fd575-4b38-4ab0-aa32-b7ea9f67c0ff] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:38:15.151365 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-370f1265-efe1-4ed5-b8b6-d6489401a8f2 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:15.152796 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-370f1265-efe1-4ed5-b8b6-d6489401a8f2 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:15.154583 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-370f1265-efe1-4ed5-b8b6-d6489401a8f2 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:15.155717 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-370f1265-efe1-4ed5-b8b6-d6489401a8f2 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:15.335742 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-370f1265-efe1-4ed5-b8b6-d6489401a8f2 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebdf8e3cd1b44dcba37cdcfb4af7db2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a8e1d26bdfc400ebd1e070b09db615e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:38:15.353035 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-370f1265-efe1-4ed5-b8b6-d6489401a8f2 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] 10.222.0.30 "GET /compute/v2.1/servers/476fd575-4b38-4ab0-aa32-b7ea9f67c0ff" status: 200 len: 1295 microversion: 2.1 time: 0.240463 Jun 16 18:38:15.354785 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 421/878] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:38:15 2022] GET /compute/v2.1/servers/476fd575-4b38-4ab0-aa32-b7ea9f67c0ff => generated 1295 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:38:16.374710 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-362ce4b4-ee25-473a-84ab-6453f14d8522 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:38:16.375432 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-362ce4b4-ee25-473a-84ab-6453f14d8522 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] [instance: 476fd575-4b38-4ab0-aa32-b7ea9f67c0ff] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:38:16.387504 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-362ce4b4-ee25-473a-84ab-6453f14d8522 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:16.389019 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-362ce4b4-ee25-473a-84ab-6453f14d8522 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:16.390174 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-362ce4b4-ee25-473a-84ab-6453f14d8522 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:16.390879 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-362ce4b4-ee25-473a-84ab-6453f14d8522 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:16.736979 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-362ce4b4-ee25-473a-84ab-6453f14d8522 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebdf8e3cd1b44dcba37cdcfb4af7db2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a8e1d26bdfc400ebd1e070b09db615e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:38:16.775240 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-362ce4b4-ee25-473a-84ab-6453f14d8522 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] 10.222.0.30 "GET /compute/v2.1/servers/476fd575-4b38-4ab0-aa32-b7ea9f67c0ff" status: 200 len: 1362 microversion: 2.1 time: 0.404002 Jun 16 18:38:16.776875 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 458/879] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:38:16 2022] GET /compute/v2.1/servers/476fd575-4b38-4ab0-aa32-b7ea9f67c0ff => generated 1362 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:38:17.051444 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [req-c40a787d-503b-4e51-a6a9-812f5c0cb018 req-75175984-c658-4ff4-8821-e8b45a8fe3a1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "476fd575-4b38-4ab0-aa32-b7ea9f67c0ff", "tag": "a9232a51-386a-40f9-afa6-6e6866dfac4b"}]} {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:38:17.088258 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [req-c40a787d-503b-4e51-a6a9-812f5c0cb018 req-75175984-c658-4ff4-8821-e8b45a8fe3a1 service nova] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:17.089045 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [req-c40a787d-503b-4e51-a6a9-812f5c0cb018 req-75175984-c658-4ff4-8821-e8b45a8fe3a1 service nova] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:17.129431 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.compute.server_external_events [req-c40a787d-503b-4e51-a6a9-812f5c0cb018 req-75175984-c658-4ff4-8821-e8b45a8fe3a1 service nova] Creating event network-changed:a9232a51-386a-40f9-afa6-6e6866dfac4b for instance 476fd575-4b38-4ab0-aa32-b7ea9f67c0ff on hv-cinder-81322 Jun 16 18:38:17.164476 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [req-c40a787d-503b-4e51-a6a9-812f5c0cb018 req-75175984-c658-4ff4-8821-e8b45a8fe3a1 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.121045 Jun 16 18:38:17.165990 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 422/880] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Jun 16 18:38:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:38:17.808196 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-46086d8a-bf3b-4bdf-be09-3653ffdd840d tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:38:17.808925 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-46086d8a-bf3b-4bdf-be09-3653ffdd840d tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] [instance: 476fd575-4b38-4ab0-aa32-b7ea9f67c0ff] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:38:17.828192 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-46086d8a-bf3b-4bdf-be09-3653ffdd840d tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:17.829108 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-46086d8a-bf3b-4bdf-be09-3653ffdd840d tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:17.830923 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-46086d8a-bf3b-4bdf-be09-3653ffdd840d tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:17.831873 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-46086d8a-bf3b-4bdf-be09-3653ffdd840d tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:18.084243 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-46086d8a-bf3b-4bdf-be09-3653ffdd840d tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebdf8e3cd1b44dcba37cdcfb4af7db2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a8e1d26bdfc400ebd1e070b09db615e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:38:18.099654 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-46086d8a-bf3b-4bdf-be09-3653ffdd840d tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] 10.222.0.30 "GET /compute/v2.1/servers/476fd575-4b38-4ab0-aa32-b7ea9f67c0ff" status: 200 len: 1362 microversion: 2.1 time: 0.298465 Jun 16 18:38:18.100889 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 459/881] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:38:17 2022] GET /compute/v2.1/servers/476fd575-4b38-4ab0-aa32-b7ea9f67c0ff => generated 1362 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:38:19.124164 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-8c22954f-b77d-47d4-9d55-d7563dee106e tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:38:19.130833 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-8c22954f-b77d-47d4-9d55-d7563dee106e tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] [instance: 476fd575-4b38-4ab0-aa32-b7ea9f67c0ff] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:38:19.137244 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-8c22954f-b77d-47d4-9d55-d7563dee106e tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:19.138109 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-8c22954f-b77d-47d4-9d55-d7563dee106e tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:19.139612 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-8c22954f-b77d-47d4-9d55-d7563dee106e tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:19.146207 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-8c22954f-b77d-47d4-9d55-d7563dee106e tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:19.343865 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-8c22954f-b77d-47d4-9d55-d7563dee106e tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebdf8e3cd1b44dcba37cdcfb4af7db2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a8e1d26bdfc400ebd1e070b09db615e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:38:19.354034 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-8c22954f-b77d-47d4-9d55-d7563dee106e tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] 10.222.0.30 "GET /compute/v2.1/servers/476fd575-4b38-4ab0-aa32-b7ea9f67c0ff" status: 200 len: 1362 microversion: 2.1 time: 0.238299 Jun 16 18:38:19.354886 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 423/882] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:38:19 2022] GET /compute/v2.1/servers/476fd575-4b38-4ab0-aa32-b7ea9f67c0ff => generated 1362 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:38:20.381773 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-2a16ad1f-a0e5-4a6f-8ae5-cc4f5015508e tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:38:20.382424 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-2a16ad1f-a0e5-4a6f-8ae5-cc4f5015508e tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] [instance: 476fd575-4b38-4ab0-aa32-b7ea9f67c0ff] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:38:20.389506 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-2a16ad1f-a0e5-4a6f-8ae5-cc4f5015508e tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:20.390006 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-2a16ad1f-a0e5-4a6f-8ae5-cc4f5015508e tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:20.390872 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-2a16ad1f-a0e5-4a6f-8ae5-cc4f5015508e tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:20.391365 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-2a16ad1f-a0e5-4a6f-8ae5-cc4f5015508e tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:20.565828 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-2a16ad1f-a0e5-4a6f-8ae5-cc4f5015508e tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebdf8e3cd1b44dcba37cdcfb4af7db2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a8e1d26bdfc400ebd1e070b09db615e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:38:20.580935 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-2a16ad1f-a0e5-4a6f-8ae5-cc4f5015508e tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] 10.222.0.30 "GET /compute/v2.1/servers/476fd575-4b38-4ab0-aa32-b7ea9f67c0ff" status: 200 len: 1362 microversion: 2.1 time: 0.204213 Jun 16 18:38:20.582062 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 460/883] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:38:20 2022] GET /compute/v2.1/servers/476fd575-4b38-4ab0-aa32-b7ea9f67c0ff => generated 1362 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:38:21.607668 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-12ea1861-244f-4a1b-bee4-d0fc312ebac8 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:38:21.608454 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-12ea1861-244f-4a1b-bee4-d0fc312ebac8 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] [instance: 476fd575-4b38-4ab0-aa32-b7ea9f67c0ff] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:38:21.618092 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-12ea1861-244f-4a1b-bee4-d0fc312ebac8 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:21.618608 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-12ea1861-244f-4a1b-bee4-d0fc312ebac8 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:21.619475 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-12ea1861-244f-4a1b-bee4-d0fc312ebac8 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:21.620097 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-12ea1861-244f-4a1b-bee4-d0fc312ebac8 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:21.804845 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-12ea1861-244f-4a1b-bee4-d0fc312ebac8 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebdf8e3cd1b44dcba37cdcfb4af7db2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a8e1d26bdfc400ebd1e070b09db615e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:38:21.815605 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-12ea1861-244f-4a1b-bee4-d0fc312ebac8 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] 10.222.0.30 "GET /compute/v2.1/servers/476fd575-4b38-4ab0-aa32-b7ea9f67c0ff" status: 200 len: 1362 microversion: 2.1 time: 0.212147 Jun 16 18:38:21.816973 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 424/884] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:38:21 2022] GET /compute/v2.1/servers/476fd575-4b38-4ab0-aa32-b7ea9f67c0ff => generated 1362 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:38:22.772639 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [req-cf4e90cc-65bb-4ce3-8161-b2182d1df123 req-52989414-1a72-4532-933d-2e774bf2c607 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "476fd575-4b38-4ab0-aa32-b7ea9f67c0ff", "name": "network-vif-plugged", "status": "completed", "tag": "a9232a51-386a-40f9-afa6-6e6866dfac4b"}]} {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:38:22.779240 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG dbcounter [-] [117670] Writing DB stats nova_cell0:SELECT=2 {{(pid=117670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:22.780531 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG dbcounter [-] [117670] Writing DB stats nova_cell0:SELECT=6 {{(pid=117670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:22.792167 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [req-cf4e90cc-65bb-4ce3-8161-b2182d1df123 req-52989414-1a72-4532-933d-2e774bf2c607 service nova] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:22.792167 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [req-cf4e90cc-65bb-4ce3-8161-b2182d1df123 req-52989414-1a72-4532-933d-2e774bf2c607 service nova] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:22.804494 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.compute.server_external_events [req-cf4e90cc-65bb-4ce3-8161-b2182d1df123 req-52989414-1a72-4532-933d-2e774bf2c607 service nova] Creating event network-vif-plugged:a9232a51-386a-40f9-afa6-6e6866dfac4b for instance 476fd575-4b38-4ab0-aa32-b7ea9f67c0ff on hv-cinder-81322 Jun 16 18:38:22.809713 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [req-cf4e90cc-65bb-4ce3-8161-b2182d1df123 req-52989414-1a72-4532-933d-2e774bf2c607 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041537 Jun 16 18:38:22.810530 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 461/885] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Jun 16 18:38:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:38:22.837354 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-f1ed6506-80ab-4883-95e9-e47ca64edfff tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:38:22.837980 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-f1ed6506-80ab-4883-95e9-e47ca64edfff tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] [instance: 476fd575-4b38-4ab0-aa32-b7ea9f67c0ff] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:38:22.846345 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-f1ed6506-80ab-4883-95e9-e47ca64edfff tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:22.849260 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-f1ed6506-80ab-4883-95e9-e47ca64edfff tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:22.850938 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-f1ed6506-80ab-4883-95e9-e47ca64edfff tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:22.851867 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-f1ed6506-80ab-4883-95e9-e47ca64edfff tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:22.897692 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG dbcounter [-] [117671] Writing DB stats nova_cell0:SELECT=6 {{(pid=117671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:23.187276 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-f1ed6506-80ab-4883-95e9-e47ca64edfff tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebdf8e3cd1b44dcba37cdcfb4af7db2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a8e1d26bdfc400ebd1e070b09db615e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:38:23.197134 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-f1ed6506-80ab-4883-95e9-e47ca64edfff tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] 10.222.0.30 "GET /compute/v2.1/servers/476fd575-4b38-4ab0-aa32-b7ea9f67c0ff" status: 200 len: 1362 microversion: 2.1 time: 0.366850 Jun 16 18:38:23.197621 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 425/886] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:38:22 2022] GET /compute/v2.1/servers/476fd575-4b38-4ab0-aa32-b7ea9f67c0ff => generated 1362 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:38:24.216348 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-35847fb7-d620-4296-9579-8270d393055d tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:38:24.217114 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-35847fb7-d620-4296-9579-8270d393055d tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] [instance: 476fd575-4b38-4ab0-aa32-b7ea9f67c0ff] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:38:24.225982 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-35847fb7-d620-4296-9579-8270d393055d tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:24.226459 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-35847fb7-d620-4296-9579-8270d393055d tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:24.227239 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-35847fb7-d620-4296-9579-8270d393055d tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:24.227760 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-35847fb7-d620-4296-9579-8270d393055d tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:24.390429 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-35847fb7-d620-4296-9579-8270d393055d tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebdf8e3cd1b44dcba37cdcfb4af7db2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a8e1d26bdfc400ebd1e070b09db615e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:38:24.400424 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-35847fb7-d620-4296-9579-8270d393055d tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] 10.222.0.30 "GET /compute/v2.1/servers/476fd575-4b38-4ab0-aa32-b7ea9f67c0ff" status: 200 len: 1362 microversion: 2.1 time: 0.188449 Jun 16 18:38:24.400933 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 462/887] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:38:24 2022] GET /compute/v2.1/servers/476fd575-4b38-4ab0-aa32-b7ea9f67c0ff => generated 1362 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:38:25.419635 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-f63ec3ce-5ef8-48c7-9519-b3105d5d8dbe tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:38:25.420428 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-f63ec3ce-5ef8-48c7-9519-b3105d5d8dbe tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] [instance: 476fd575-4b38-4ab0-aa32-b7ea9f67c0ff] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:38:25.428340 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-f63ec3ce-5ef8-48c7-9519-b3105d5d8dbe tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:25.428892 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-f63ec3ce-5ef8-48c7-9519-b3105d5d8dbe tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:25.429703 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-f63ec3ce-5ef8-48c7-9519-b3105d5d8dbe tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:25.430188 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-f63ec3ce-5ef8-48c7-9519-b3105d5d8dbe tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:25.610765 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-f63ec3ce-5ef8-48c7-9519-b3105d5d8dbe tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebdf8e3cd1b44dcba37cdcfb4af7db2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a8e1d26bdfc400ebd1e070b09db615e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:38:25.618781 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-f63ec3ce-5ef8-48c7-9519-b3105d5d8dbe tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] 10.222.0.30 "GET /compute/v2.1/servers/476fd575-4b38-4ab0-aa32-b7ea9f67c0ff" status: 200 len: 1548 microversion: 2.1 time: 0.204258 Jun 16 18:38:25.619386 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 426/888] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:38:25 2022] GET /compute/v2.1/servers/476fd575-4b38-4ab0-aa32-b7ea9f67c0ff => generated 1548 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:38:25.636958 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-151567e6-0afc-4d1c-ab30-1b4030004976 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:38:25.637850 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-151567e6-0afc-4d1c-ab30-1b4030004976 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] [instance: 476fd575-4b38-4ab0-aa32-b7ea9f67c0ff] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:38:25.646322 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-151567e6-0afc-4d1c-ab30-1b4030004976 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:25.646768 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-151567e6-0afc-4d1c-ab30-1b4030004976 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:25.647546 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-151567e6-0afc-4d1c-ab30-1b4030004976 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:25.648125 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-151567e6-0afc-4d1c-ab30-1b4030004976 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:25.736811 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-151567e6-0afc-4d1c-ab30-1b4030004976 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] 10.222.0.30 "GET /compute/v2.1/servers/476fd575-4b38-4ab0-aa32-b7ea9f67c0ff/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.103399 Jun 16 18:38:25.737836 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 463/889] 10.222.0.30 () {58 vars in 1274 bytes} [Thu Jun 16 18:38:25 2022] GET /compute/v2.1/servers/476fd575-4b38-4ab0-aa32-b7ea9f67c0ff/os-interface => generated 285 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:38:27.312822 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [req-44e48d41-b4f8-42ee-a076-80ad76d2dc0d req-5987acf3-10d3-4004-ac82-b89538b03c00 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "476fd575-4b38-4ab0-aa32-b7ea9f67c0ff", "tag": "a9232a51-386a-40f9-afa6-6e6866dfac4b"}]} {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:38:27.325892 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [req-44e48d41-b4f8-42ee-a076-80ad76d2dc0d req-5987acf3-10d3-4004-ac82-b89538b03c00 service nova] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:27.327172 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [req-44e48d41-b4f8-42ee-a076-80ad76d2dc0d req-5987acf3-10d3-4004-ac82-b89538b03c00 service nova] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:27.347142 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.compute.server_external_events [req-44e48d41-b4f8-42ee-a076-80ad76d2dc0d req-5987acf3-10d3-4004-ac82-b89538b03c00 service nova] Creating event network-changed:a9232a51-386a-40f9-afa6-6e6866dfac4b for instance 476fd575-4b38-4ab0-aa32-b7ea9f67c0ff on hv-cinder-81322 Jun 16 18:38:27.354313 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [req-44e48d41-b4f8-42ee-a076-80ad76d2dc0d req-5987acf3-10d3-4004-ac82-b89538b03c00 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045969 Jun 16 18:38:27.355800 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 427/890] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Jun 16 18:38:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:38:58.934065 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG dbcounter [-] [117670] Writing DB stats nova_api:SELECT=39,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=117670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:58.934868 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG dbcounter [-] [117670] Writing DB stats nova_cell1:SELECT=46 {{(pid=117670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:58.937314 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG dbcounter [-] [117671] Writing DB stats nova_api:SELECT=41,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=117671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:58.938544 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG dbcounter [-] [117671] Writing DB stats nova_cell1:SELECT=35 {{(pid=117671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:38:58.942260 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-c065691a-dfd0-429a-a9fb-3c69e1bec35d tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:38:58.942767 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-c065691a-dfd0-429a-a9fb-3c69e1bec35d tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] [instance: 858d3b02-c17d-4868-8adc-08e94d31c29c] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:38:58.945399 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [req-18941acd-4c2d-4fd5-a673-7a22c60f1411 req-4c6bf71d-ca11-494c-b38b-ae7d7ba6208b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "858d3b02-c17d-4868-8adc-08e94d31c29c", "tag": "68356597-c3ad-4071-ac45-b2f7aa7bca35"}]} {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:38:58.955060 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-c065691a-dfd0-429a-a9fb-3c69e1bec35d tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:58.955878 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-c065691a-dfd0-429a-a9fb-3c69e1bec35d tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:58.956895 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [req-18941acd-4c2d-4fd5-a673-7a22c60f1411 req-4c6bf71d-ca11-494c-b38b-ae7d7ba6208b service nova] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:58.957435 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [req-18941acd-4c2d-4fd5-a673-7a22c60f1411 req-4c6bf71d-ca11-494c-b38b-ae7d7ba6208b service nova] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:58.957631 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-c065691a-dfd0-429a-a9fb-3c69e1bec35d tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:58.958303 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-c065691a-dfd0-429a-a9fb-3c69e1bec35d tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:58.980906 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.compute.server_external_events [req-18941acd-4c2d-4fd5-a673-7a22c60f1411 req-4c6bf71d-ca11-494c-b38b-ae7d7ba6208b service nova] Creating event network-changed:68356597-c3ad-4071-ac45-b2f7aa7bca35 for instance 858d3b02-c17d-4868-8adc-08e94d31c29c on hv-cinder-81322 Jun 16 18:38:58.991888 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [req-18941acd-4c2d-4fd5-a673-7a22c60f1411 req-4c6bf71d-ca11-494c-b38b-ae7d7ba6208b service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057126 Jun 16 18:38:58.993447 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 428/891] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Jun 16 18:38:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 18:38:59.014273 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-c065691a-dfd0-429a-a9fb-3c69e1bec35d tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] [instance: 858d3b02-c17d-4868-8adc-08e94d31c29c] Going to try to terminate instance {{(pid=117670) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 18:38:59.183355 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-c065691a-dfd0-429a-a9fb-3c69e1bec35d tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] 10.222.0.30 "DELETE /compute/v2.1/servers/858d3b02-c17d-4868-8adc-08e94d31c29c" status: 204 len: 0 microversion: 2.1 time: 0.250168 Jun 16 18:38:59.186058 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 464/892] 10.222.0.30 () {58 vars in 1238 bytes} [Thu Jun 16 18:38:58 2022] DELETE /compute/v2.1/servers/858d3b02-c17d-4868-8adc-08e94d31c29c => generated 0 bytes in 254 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 18:38:59.204201 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-a112d283-25d1-4ad8-a016-2ce33c7f16f3 tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:38:59.207868 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-a112d283-25d1-4ad8-a016-2ce33c7f16f3 tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] [instance: 858d3b02-c17d-4868-8adc-08e94d31c29c] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:38:59.220871 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-a112d283-25d1-4ad8-a016-2ce33c7f16f3 tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:59.222051 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-a112d283-25d1-4ad8-a016-2ce33c7f16f3 tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:59.223125 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-a112d283-25d1-4ad8-a016-2ce33c7f16f3 tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:38:59.224102 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-a112d283-25d1-4ad8-a016-2ce33c7f16f3 tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:38:59.673478 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-a112d283-25d1-4ad8-a016-2ce33c7f16f3 tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc31f4b39704173858410ae52ac2c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9f254f568e4bd98b2e4087c3a32c04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:38:59.682330 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-a112d283-25d1-4ad8-a016-2ce33c7f16f3 tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] 10.222.0.30 "GET /compute/v2.1/servers/858d3b02-c17d-4868-8adc-08e94d31c29c" status: 200 len: 1568 microversion: 2.1 time: 0.488821 Jun 16 18:38:59.682931 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 429/893] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:38:59 2022] GET /compute/v2.1/servers/858d3b02-c17d-4868-8adc-08e94d31c29c => generated 1568 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:39:00.715442 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-496c74e2-6c39-4e88-aa4d-83cbc3cc9608 tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:39:00.716657 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-496c74e2-6c39-4e88-aa4d-83cbc3cc9608 tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] [instance: 858d3b02-c17d-4868-8adc-08e94d31c29c] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:39:00.729648 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-496c74e2-6c39-4e88-aa4d-83cbc3cc9608 tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:39:00.730431 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-496c74e2-6c39-4e88-aa4d-83cbc3cc9608 tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:39:00.731872 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-496c74e2-6c39-4e88-aa4d-83cbc3cc9608 tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:39:00.732719 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-496c74e2-6c39-4e88-aa4d-83cbc3cc9608 tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:39:01.240730 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-496c74e2-6c39-4e88-aa4d-83cbc3cc9608 tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc31f4b39704173858410ae52ac2c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9f254f568e4bd98b2e4087c3a32c04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:39:01.251595 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-496c74e2-6c39-4e88-aa4d-83cbc3cc9608 tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] 10.222.0.30 "GET /compute/v2.1/servers/858d3b02-c17d-4868-8adc-08e94d31c29c" status: 200 len: 1568 microversion: 2.1 time: 0.544227 Jun 16 18:39:01.252500 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 465/894] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:39:00 2022] GET /compute/v2.1/servers/858d3b02-c17d-4868-8adc-08e94d31c29c => generated 1568 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:39:01.593829 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [req-7896a664-3dce-4954-8a57-9a6800f1ee4c req-f3f19896-48cc-4629-82a0-2991525d9ed9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "858d3b02-c17d-4868-8adc-08e94d31c29c", "name": "network-vif-deleted", "tag": "68356597-c3ad-4071-ac45-b2f7aa7bca35"}]} {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:39:01.608663 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [req-7896a664-3dce-4954-8a57-9a6800f1ee4c req-f3f19896-48cc-4629-82a0-2991525d9ed9 service nova] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:39:01.610022 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [req-7896a664-3dce-4954-8a57-9a6800f1ee4c req-f3f19896-48cc-4629-82a0-2991525d9ed9 service nova] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:39:01.627654 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.compute.server_external_events [req-7896a664-3dce-4954-8a57-9a6800f1ee4c req-f3f19896-48cc-4629-82a0-2991525d9ed9 service nova] Creating event network-vif-deleted:68356597-c3ad-4071-ac45-b2f7aa7bca35 for instance 858d3b02-c17d-4868-8adc-08e94d31c29c on hv-cinder-81322 Jun 16 18:39:01.633188 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [req-7896a664-3dce-4954-8a57-9a6800f1ee4c req-f3f19896-48cc-4629-82a0-2991525d9ed9 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045129 Jun 16 18:39:01.633745 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 430/895] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Jun 16 18:39:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:39:02.273322 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-1431e3e3-d18f-4fe7-acea-f6d1437d95ab tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:39:02.274026 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-1431e3e3-d18f-4fe7-acea-f6d1437d95ab tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] [instance: 858d3b02-c17d-4868-8adc-08e94d31c29c] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:39:02.282625 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-1431e3e3-d18f-4fe7-acea-f6d1437d95ab tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:39:02.283000 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-1431e3e3-d18f-4fe7-acea-f6d1437d95ab tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:39:02.283645 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-1431e3e3-d18f-4fe7-acea-f6d1437d95ab tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:39:02.284160 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-1431e3e3-d18f-4fe7-acea-f6d1437d95ab tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:39:02.324381 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-1431e3e3-d18f-4fe7-acea-f6d1437d95ab tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:39:02.324843 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-1431e3e3-d18f-4fe7-acea-f6d1437d95ab tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:39:02.325315 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.objects.instance [None req-1431e3e3-d18f-4fe7-acea-f6d1437d95ab tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Lazy-loading 'fault' on Instance uuid 858d3b02-c17d-4868-8adc-08e94d31c29c {{(pid=117670) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 18:39:02.395371 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-1431e3e3-d18f-4fe7-acea-f6d1437d95ab tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc31f4b39704173858410ae52ac2c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9f254f568e4bd98b2e4087c3a32c04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:39:02.410846 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-1431e3e3-d18f-4fe7-acea-f6d1437d95ab tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] 10.222.0.30 "GET /compute/v2.1/servers/858d3b02-c17d-4868-8adc-08e94d31c29c" status: 200 len: 1225 microversion: 2.1 time: 0.141082 Jun 16 18:39:02.412152 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 466/896] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:39:02 2022] GET /compute/v2.1/servers/858d3b02-c17d-4868-8adc-08e94d31c29c => generated 1225 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:39:02.507834 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-78c3f678-979d-412b-b05c-02220eb1c6a1 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:39:02.508585 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-78c3f678-979d-412b-b05c-02220eb1c6a1 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] [instance: 476fd575-4b38-4ab0-aa32-b7ea9f67c0ff] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:39:02.517091 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-78c3f678-979d-412b-b05c-02220eb1c6a1 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:39:02.517604 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-78c3f678-979d-412b-b05c-02220eb1c6a1 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:39:02.518416 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-78c3f678-979d-412b-b05c-02220eb1c6a1 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:39:02.518862 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-78c3f678-979d-412b-b05c-02220eb1c6a1 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:39:02.546198 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-78c3f678-979d-412b-b05c-02220eb1c6a1 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] 10.222.0.30 "GET /compute/v2.1/servers/476fd575-4b38-4ab0-aa32-b7ea9f67c0ff/ips" status: 200 len: 145 microversion: 2.1 time: 0.042819 Jun 16 18:39:02.547579 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 431/897] 10.222.0.30 () {58 vars in 1247 bytes} [Thu Jun 16 18:39:02 2022] GET /compute/v2.1/servers/476fd575-4b38-4ab0-aa32-b7ea9f67c0ff/ips => generated 145 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:39:03.432138 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-3c257c89-1475-4dc9-944b-dc3f24c351cb tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:39:03.433031 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-3c257c89-1475-4dc9-944b-dc3f24c351cb tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] [instance: 858d3b02-c17d-4868-8adc-08e94d31c29c] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:39:03.441780 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-3c257c89-1475-4dc9-944b-dc3f24c351cb tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:39:03.442320 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-3c257c89-1475-4dc9-944b-dc3f24c351cb tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:39:03.443439 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-3c257c89-1475-4dc9-944b-dc3f24c351cb tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:39:03.443953 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-3c257c89-1475-4dc9-944b-dc3f24c351cb tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:39:03.460207 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.wsgi [None req-3c257c89-1475-4dc9-944b-dc3f24c351cb tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] HTTP exception thrown: Instance 858d3b02-c17d-4868-8adc-08e94d31c29c could not be found. Jun 16 18:39:03.461940 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-3c257c89-1475-4dc9-944b-dc3f24c351cb tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Request method failure captured: Jun 16 18:39:03.461940 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: request: GET /compute/v2.1/servers/858d3b02-c17d-4868-8adc-08e94d31c29c HTTP/1.1 Jun 16 18:39:03.461940 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: Accept: application/json Jun 16 18:39:03.461940 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: Accept-Encoding: identity Jun 16 18:39:03.461940 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: Connection: close Jun 16 18:39:03.461940 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: Content-Length: 0 Jun 16 18:39:03.461940 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: Content-Type: application/json Jun 16 18:39:03.461940 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: Host: 10.222.0.30 Jun 16 18:39:03.461940 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: Openstack-System-Scope: None Jun 16 18:39:03.461940 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: User-Agent: python-urllib3/1.26.9 Jun 16 18:39:03.461940 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Auth-Token: gAAAAABiq3eZTs0yF66uE-WwmIkk7mP2e4Ms2bbLdvAzWDVRgDhf-75Hx0ap4IffKoY_lAHCIf9lLnHB1h3gwwrANtG1zvNbOWZJAymjtPnzDuAJFQGqaTcnjX04WOrKYkngi-2BTzscYfrDphAO82d_aN9hKi09fYhkaexH2fh3XS62n1q2DqY Jun 16 18:39:03.461940 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Domain-Id: None Jun 16 18:39:03.461940 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Domain-Name: None Jun 16 18:39:03.461940 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Identity-Status: Confirmed Jun 16 18:39:03.461940 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Is-Admin-Project: True Jun 16 18:39:03.461940 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Project-Domain-Id: default Jun 16 18:39:03.461940 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Project-Domain-Name: Default Jun 16 18:39:03.461940 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Project-Id: 4d9f254f568e4bd98b2e4087c3a32c04 Jun 16 18:39:03.461940 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Project-Name: tempest-TestShelveInstance-624183226 Jun 16 18:39:03.461940 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Role: reader,member Jun 16 18:39:03.461940 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Roles: reader,member Jun 16 18:39:03.464564 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/4d9f254f568e4bd98b2e4087c3a32c04"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/4d9f254f568e4bd98b2e4087c3a32c04"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_4d9f254f568e4bd98b2e4087c3a32c04", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/4d9f254f568e4bd98b2e4087c3a32c04"}]}] Jun 16 18:39:03.464564 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Tenant: tempest-TestShelveInstance-624183226 Jun 16 18:39:03.464564 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Tenant-Id: 4d9f254f568e4bd98b2e4087c3a32c04 Jun 16 18:39:03.464564 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Tenant-Name: tempest-TestShelveInstance-624183226 Jun 16 18:39:03.464564 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-User: tempest-TestShelveInstance-624183226-project Jun 16 18:39:03.464564 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-User-Domain-Id: default Jun 16 18:39:03.464564 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-User-Domain-Name: Default Jun 16 18:39:03.464564 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-User-Id: 0cc31f4b39704173858410ae52ac2c66 Jun 16 18:39:03.464564 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-User-Name: tempest-TestShelveInstance-624183226-project Jun 16 18:39:03.464564 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: method: > Jun 16 18:39:03.464564 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: exception: Instance 858d3b02-c17d-4868-8adc-08e94d31c29c could not be found. Jun 16 18:39:03.464564 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: action_args: {'id': '858d3b02-c17d-4868-8adc-08e94d31c29c'} Jun 16 18:39:03.466142 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:39:03.466142 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:39:03.466142 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 18:39:03.466142 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 18:39:03.466142 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 18:39:03.466142 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 18:39:03.466142 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 18:39:03.466142 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 18:39:03.466142 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 18:39:03.466142 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 18:39:03.466142 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 858d3b02-c17d-4868-8adc-08e94d31c29c could not be found. Jun 16 18:39:03.466142 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi Jun 16 18:39:03.466142 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:39:03.466142 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi Jun 16 18:39:03.466142 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:39:03.466142 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:39:03.466142 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:39:03.466142 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:39:03.466142 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:39:03.466142 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:39:03.468580 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:39:03.468580 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 18:39:03.468580 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 18:39:03.468580 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 18:39:03.468580 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 18:39:03.468580 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 18:39:03.468580 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:39:03.468580 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 858d3b02-c17d-4868-8adc-08e94d31c29c could not be found. Jun 16 18:39:03.468580 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi Jun 16 18:39:03.468580 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:39:03.468580 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi Jun 16 18:39:03.468580 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:39:03.468580 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:39:03.468580 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:39:03.468580 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:39:03.468580 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:39:03.468580 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 858d3b02-c17d-4868-8adc-08e94d31c29c could not be found. Jun 16 18:39:03.468580 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi Jun 16 18:39:03.471443 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-3c257c89-1475-4dc9-944b-dc3f24c351cb tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Returning 404 to user: Instance 858d3b02-c17d-4868-8adc-08e94d31c29c could not be found. {{(pid=117670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:39:03.471443 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-3c257c89-1475-4dc9-944b-dc3f24c351cb tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] 10.222.0.30 "GET /compute/v2.1/servers/858d3b02-c17d-4868-8adc-08e94d31c29c" status: 404 len: 111 microversion: 2.1 time: 0.036790 Jun 16 18:39:03.471443 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 467/898] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:39:03 2022] GET /compute/v2.1/servers/858d3b02-c17d-4868-8adc-08e94d31c29c => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:39:03.744906 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-d46dedbc-5b26-4b4b-966a-b98069dc0c4e tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] Calling method '.version_select at 0x7fbb23d59160>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:39:03.767658 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-d46dedbc-5b26-4b4b-966a-b98069dc0c4e tempest-TestShelveInstance-624183226 tempest-TestShelveInstance-624183226-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1758465465" status: 202 len: 0 microversion: 2.1 time: 0.027129 Jun 16 18:39:03.768291 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 432/899] 10.222.0.30 () {58 vars in 1253 bytes} [Thu Jun 16 18:39:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1758465465 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 16 18:39:04.008517 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-4260be34-a7e8-4883-ad46-61b56752f695 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f9b5fbc6-42cd-47a8-ad17-c1465ab93ba6"}} {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:39:04.010057 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-4260be34-a7e8-4883-ad46-61b56752f695 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] [instance: 476fd575-4b38-4ab0-aa32-b7ea9f67c0ff] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:39:04.019364 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-4260be34-a7e8-4883-ad46-61b56752f695 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:39:04.020281 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-4260be34-a7e8-4883-ad46-61b56752f695 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:39:04.021730 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-4260be34-a7e8-4883-ad46-61b56752f695 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:39:04.022640 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-4260be34-a7e8-4883-ad46-61b56752f695 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:39:04.397932 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-4260be34-a7e8-4883-ad46-61b56752f695 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] 10.222.0.30 "POST /compute/v2.1/servers/476fd575-4b38-4ab0-aa32-b7ea9f67c0ff/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.393750 Jun 16 18:39:04.399120 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 468/900] 10.222.0.30 () {60 vars in 1322 bytes} [Thu Jun 16 18:39:04 2022] POST /compute/v2.1/servers/476fd575-4b38-4ab0-aa32-b7ea9f67c0ff/os-volume_attachments => generated 194 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 18:39:11.150615 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-4875ac5b-ce3c-4b05-bfcb-ba037955ec2f tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:39:11.152412 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-4875ac5b-ce3c-4b05-bfcb-ba037955ec2f tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] [instance: 476fd575-4b38-4ab0-aa32-b7ea9f67c0ff] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:39:11.160949 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-4875ac5b-ce3c-4b05-bfcb-ba037955ec2f tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:39:11.161435 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-4875ac5b-ce3c-4b05-bfcb-ba037955ec2f tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:39:11.162250 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-4875ac5b-ce3c-4b05-bfcb-ba037955ec2f tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:39:11.163197 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-4875ac5b-ce3c-4b05-bfcb-ba037955ec2f tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:39:11.198431 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-4875ac5b-ce3c-4b05-bfcb-ba037955ec2f tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] 10.222.0.30 "GET /compute/v2.1/servers/476fd575-4b38-4ab0-aa32-b7ea9f67c0ff/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053566 Jun 16 18:39:11.202459 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 433/901] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Jun 16 18:39:11 2022] GET /compute/v2.1/servers/476fd575-4b38-4ab0-aa32-b7ea9f67c0ff/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:39:11.214064 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-fdb9d0ff-f6bd-4969-af2f-80037c1028fd tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:39:11.215034 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-fdb9d0ff-f6bd-4969-af2f-80037c1028fd tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] [instance: 476fd575-4b38-4ab0-aa32-b7ea9f67c0ff] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:39:11.230178 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-fdb9d0ff-f6bd-4969-af2f-80037c1028fd tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:39:11.231076 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-fdb9d0ff-f6bd-4969-af2f-80037c1028fd tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:39:11.233164 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-fdb9d0ff-f6bd-4969-af2f-80037c1028fd tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:39:11.234574 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-fdb9d0ff-f6bd-4969-af2f-80037c1028fd tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:39:11.283053 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-fdb9d0ff-f6bd-4969-af2f-80037c1028fd tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] 10.222.0.30 "GET /compute/v2.1/servers/476fd575-4b38-4ab0-aa32-b7ea9f67c0ff/os-volume_attachments/f9b5fbc6-42cd-47a8-ad17-c1465ab93ba6" status: 200 len: 194 microversion: 2.1 time: 0.075359 Jun 16 18:39:11.288947 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 469/902] 10.222.0.30 () {58 vars in 1412 bytes} [Thu Jun 16 18:39:11 2022] GET /compute/v2.1/servers/476fd575-4b38-4ab0-aa32-b7ea9f67c0ff/os-volume_attachments/f9b5fbc6-42cd-47a8-ad17-c1465ab93ba6 => generated 194 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:39:12.807028 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-d25e0ef7-556c-43f8-98c3-691f8141e886 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1044360a-eaaa-464e-96b9-09cd9e79dd28"}} {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:39:12.808280 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-d25e0ef7-556c-43f8-98c3-691f8141e886 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] [instance: 476fd575-4b38-4ab0-aa32-b7ea9f67c0ff] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:39:12.817130 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-d25e0ef7-556c-43f8-98c3-691f8141e886 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:39:12.817585 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-d25e0ef7-556c-43f8-98c3-691f8141e886 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:39:12.818529 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-d25e0ef7-556c-43f8-98c3-691f8141e886 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:39:12.818967 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-d25e0ef7-556c-43f8-98c3-691f8141e886 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:39:13.153947 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-d25e0ef7-556c-43f8-98c3-691f8141e886 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] 10.222.0.30 "POST /compute/v2.1/servers/476fd575-4b38-4ab0-aa32-b7ea9f67c0ff/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.351357 Jun 16 18:39:13.154580 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 434/903] 10.222.0.30 () {60 vars in 1322 bytes} [Thu Jun 16 18:39:12 2022] POST /compute/v2.1/servers/476fd575-4b38-4ab0-aa32-b7ea9f67c0ff/os-volume_attachments => generated 194 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 18:39:20.978489 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-e1aaff01-dd30-459b-a4d6-81b8362babcc tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:39:20.979523 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-e1aaff01-dd30-459b-a4d6-81b8362babcc tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] [instance: 476fd575-4b38-4ab0-aa32-b7ea9f67c0ff] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:39:20.992936 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-e1aaff01-dd30-459b-a4d6-81b8362babcc tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:39:20.993902 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-e1aaff01-dd30-459b-a4d6-81b8362babcc tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:39:20.994682 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-e1aaff01-dd30-459b-a4d6-81b8362babcc tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:39:20.996265 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-e1aaff01-dd30-459b-a4d6-81b8362babcc tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:39:21.037079 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-e1aaff01-dd30-459b-a4d6-81b8362babcc tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] 10.222.0.30 "GET /compute/v2.1/servers/476fd575-4b38-4ab0-aa32-b7ea9f67c0ff/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.062641 Jun 16 18:39:21.043192 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 470/904] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Jun 16 18:39:20 2022] GET /compute/v2.1/servers/476fd575-4b38-4ab0-aa32-b7ea9f67c0ff/os-volume_attachments => generated 371 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:39:21.193629 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-e3c51b0d-cfc8-46aa-b73e-63cde0c06981 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:39:21.194587 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-e3c51b0d-cfc8-46aa-b73e-63cde0c06981 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] [instance: 476fd575-4b38-4ab0-aa32-b7ea9f67c0ff] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:39:21.210069 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-e3c51b0d-cfc8-46aa-b73e-63cde0c06981 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:39:21.211851 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-e3c51b0d-cfc8-46aa-b73e-63cde0c06981 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:39:21.213529 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-e3c51b0d-cfc8-46aa-b73e-63cde0c06981 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:39:21.216312 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-e3c51b0d-cfc8-46aa-b73e-63cde0c06981 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:39:21.269630 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-e3c51b0d-cfc8-46aa-b73e-63cde0c06981 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] 10.222.0.30 "GET /compute/v2.1/servers/476fd575-4b38-4ab0-aa32-b7ea9f67c0ff/os-volume_attachments/f9b5fbc6-42cd-47a8-ad17-c1465ab93ba6" status: 200 len: 194 microversion: 2.1 time: 0.086923 Jun 16 18:39:21.270933 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 435/905] 10.222.0.30 () {58 vars in 1412 bytes} [Thu Jun 16 18:39:21 2022] GET /compute/v2.1/servers/476fd575-4b38-4ab0-aa32-b7ea9f67c0ff/os-volume_attachments/f9b5fbc6-42cd-47a8-ad17-c1465ab93ba6 => generated 194 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:39:21.286915 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-adf4c460-84cd-40ef-a2e9-861f0dce8e2c tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:39:21.287692 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-adf4c460-84cd-40ef-a2e9-861f0dce8e2c tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] [instance: 476fd575-4b38-4ab0-aa32-b7ea9f67c0ff] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:39:21.298809 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-adf4c460-84cd-40ef-a2e9-861f0dce8e2c tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:39:21.299911 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-adf4c460-84cd-40ef-a2e9-861f0dce8e2c tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:39:21.301170 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-adf4c460-84cd-40ef-a2e9-861f0dce8e2c tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:39:21.301762 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-adf4c460-84cd-40ef-a2e9-861f0dce8e2c tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:39:21.460559 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.objects.instance [None req-adf4c460-84cd-40ef-a2e9-861f0dce8e2c tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lazy-loading 'services' on Instance uuid 476fd575-4b38-4ab0-aa32-b7ea9f67c0ff {{(pid=117670) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 18:39:21.626952 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-adf4c460-84cd-40ef-a2e9-861f0dce8e2c tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] 10.222.0.30 "DELETE /compute/v2.1/servers/476fd575-4b38-4ab0-aa32-b7ea9f67c0ff/os-volume_attachments/f9b5fbc6-42cd-47a8-ad17-c1465ab93ba6" status: 202 len: 0 microversion: 2.1 time: 0.348963 Jun 16 18:39:21.628176 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 471/906] 10.222.0.30 () {58 vars in 1415 bytes} [Thu Jun 16 18:39:21 2022] DELETE /compute/v2.1/servers/476fd575-4b38-4ab0-aa32-b7ea9f67c0ff/os-volume_attachments/f9b5fbc6-42cd-47a8-ad17-c1465ab93ba6 => generated 0 bytes in 351 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 16 18:39:22.887012 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-f602f1f5-d74b-4452-9b3a-b67521153fb7 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:39:22.888804 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-f602f1f5-d74b-4452-9b3a-b67521153fb7 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] [instance: 476fd575-4b38-4ab0-aa32-b7ea9f67c0ff] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:39:22.897744 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-f602f1f5-d74b-4452-9b3a-b67521153fb7 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:39:22.898575 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-f602f1f5-d74b-4452-9b3a-b67521153fb7 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:39:22.900290 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-f602f1f5-d74b-4452-9b3a-b67521153fb7 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:39:22.901159 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-f602f1f5-d74b-4452-9b3a-b67521153fb7 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:39:22.946701 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-f602f1f5-d74b-4452-9b3a-b67521153fb7 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] 10.222.0.30 "GET /compute/v2.1/servers/476fd575-4b38-4ab0-aa32-b7ea9f67c0ff/os-volume_attachments/1044360a-eaaa-464e-96b9-09cd9e79dd28" status: 200 len: 194 microversion: 2.1 time: 0.063999 Jun 16 18:39:22.947780 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 436/907] 10.222.0.30 () {58 vars in 1412 bytes} [Thu Jun 16 18:39:22 2022] GET /compute/v2.1/servers/476fd575-4b38-4ab0-aa32-b7ea9f67c0ff/os-volume_attachments/1044360a-eaaa-464e-96b9-09cd9e79dd28 => generated 194 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 18:39:22.962416 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-cd9e082a-d2af-48cd-9034-5d39672a85a6 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:39:22.963305 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-cd9e082a-d2af-48cd-9034-5d39672a85a6 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] [instance: 476fd575-4b38-4ab0-aa32-b7ea9f67c0ff] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:39:22.972569 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-cd9e082a-d2af-48cd-9034-5d39672a85a6 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:39:22.973450 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-cd9e082a-d2af-48cd-9034-5d39672a85a6 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:39:22.974356 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-cd9e082a-d2af-48cd-9034-5d39672a85a6 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:39:22.974907 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-cd9e082a-d2af-48cd-9034-5d39672a85a6 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:39:23.145486 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.objects.instance [None req-cd9e082a-d2af-48cd-9034-5d39672a85a6 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lazy-loading 'services' on Instance uuid 476fd575-4b38-4ab0-aa32-b7ea9f67c0ff {{(pid=117670) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 18:39:23.287546 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-cd9e082a-d2af-48cd-9034-5d39672a85a6 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] 10.222.0.30 "DELETE /compute/v2.1/servers/476fd575-4b38-4ab0-aa32-b7ea9f67c0ff/os-volume_attachments/1044360a-eaaa-464e-96b9-09cd9e79dd28" status: 202 len: 0 microversion: 2.1 time: 0.329813 Jun 16 18:39:23.289923 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 472/908] 10.222.0.30 () {58 vars in 1415 bytes} [Thu Jun 16 18:39:22 2022] DELETE /compute/v2.1/servers/476fd575-4b38-4ab0-aa32-b7ea9f67c0ff/os-volume_attachments/1044360a-eaaa-464e-96b9-09cd9e79dd28 => generated 0 bytes in 334 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 18:39:24.659550 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-3db94372-9114-4066-82b9-0156dfc60974 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:39:24.661380 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-3db94372-9114-4066-82b9-0156dfc60974 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] [instance: 476fd575-4b38-4ab0-aa32-b7ea9f67c0ff] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:39:24.693909 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-3db94372-9114-4066-82b9-0156dfc60974 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:39:24.694646 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-3db94372-9114-4066-82b9-0156dfc60974 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:39:24.695946 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-3db94372-9114-4066-82b9-0156dfc60974 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:39:24.697004 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-3db94372-9114-4066-82b9-0156dfc60974 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:39:24.765281 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-3db94372-9114-4066-82b9-0156dfc60974 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] 10.222.0.30 "GET /compute/v2.1/servers/476fd575-4b38-4ab0-aa32-b7ea9f67c0ff/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.111941 Jun 16 18:39:24.773799 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 437/909] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Jun 16 18:39:24 2022] GET /compute/v2.1/servers/476fd575-4b38-4ab0-aa32-b7ea9f67c0ff/os-volume_attachments => generated 25 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 16 18:39:24.991730 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-ea976f20-0df9-426a-b586-39f12cddb088 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:39:24.992837 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-ea976f20-0df9-426a-b586-39f12cddb088 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] [instance: 476fd575-4b38-4ab0-aa32-b7ea9f67c0ff] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:39:25.011700 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-ea976f20-0df9-426a-b586-39f12cddb088 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:39:25.012214 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-ea976f20-0df9-426a-b586-39f12cddb088 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:39:25.013057 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-ea976f20-0df9-426a-b586-39f12cddb088 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:39:25.013507 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-ea976f20-0df9-426a-b586-39f12cddb088 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:39:25.083958 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-ea976f20-0df9-426a-b586-39f12cddb088 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] 10.222.0.30 "GET /compute/v2.1/servers/476fd575-4b38-4ab0-aa32-b7ea9f67c0ff/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.096710 Jun 16 18:39:25.103585 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 473/910] 10.222.0.30 () {58 vars in 1301 bytes} [Thu Jun 16 18:39:24 2022] GET /compute/v2.1/servers/476fd575-4b38-4ab0-aa32-b7ea9f67c0ff/os-volume_attachments => generated 25 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 16 18:39:25.163957 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-f81db84f-c108-46c4-8a82-806eadaf75f9 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:39:25.164567 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-f81db84f-c108-46c4-8a82-806eadaf75f9 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] [instance: 476fd575-4b38-4ab0-aa32-b7ea9f67c0ff] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:39:25.179412 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-f81db84f-c108-46c4-8a82-806eadaf75f9 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:39:25.179882 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-f81db84f-c108-46c4-8a82-806eadaf75f9 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:39:25.181318 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-f81db84f-c108-46c4-8a82-806eadaf75f9 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:39:25.181784 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-f81db84f-c108-46c4-8a82-806eadaf75f9 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:39:25.264202 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-f81db84f-c108-46c4-8a82-806eadaf75f9 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] [instance: 476fd575-4b38-4ab0-aa32-b7ea9f67c0ff] Going to try to terminate instance {{(pid=117671) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 18:39:25.537245 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-f81db84f-c108-46c4-8a82-806eadaf75f9 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] 10.222.0.30 "DELETE /compute/v2.1/servers/476fd575-4b38-4ab0-aa32-b7ea9f67c0ff" status: 204 len: 0 microversion: 2.1 time: 0.378993 Jun 16 18:39:25.537813 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 438/911] 10.222.0.30 () {58 vars in 1238 bytes} [Thu Jun 16 18:39:25 2022] DELETE /compute/v2.1/servers/476fd575-4b38-4ab0-aa32-b7ea9f67c0ff => generated 0 bytes in 381 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 18:39:25.553275 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-d7deb92b-e977-49b6-8e5e-96b5f4904cea tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:39:25.556673 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-d7deb92b-e977-49b6-8e5e-96b5f4904cea tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] [instance: 476fd575-4b38-4ab0-aa32-b7ea9f67c0ff] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:39:25.579055 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-d7deb92b-e977-49b6-8e5e-96b5f4904cea tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:39:25.579900 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-d7deb92b-e977-49b6-8e5e-96b5f4904cea tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:39:25.581425 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-d7deb92b-e977-49b6-8e5e-96b5f4904cea tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:39:25.582097 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-d7deb92b-e977-49b6-8e5e-96b5f4904cea tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:39:25.865223 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-d7deb92b-e977-49b6-8e5e-96b5f4904cea tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebdf8e3cd1b44dcba37cdcfb4af7db2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a8e1d26bdfc400ebd1e070b09db615e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:39:25.881955 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-d7deb92b-e977-49b6-8e5e-96b5f4904cea tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] 10.222.0.30 "GET /compute/v2.1/servers/476fd575-4b38-4ab0-aa32-b7ea9f67c0ff" status: 200 len: 1672 microversion: 2.1 time: 0.338617 Jun 16 18:39:25.897433 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 474/912] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:39:25 2022] GET /compute/v2.1/servers/476fd575-4b38-4ab0-aa32-b7ea9f67c0ff => generated 1672 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:39:26.920288 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-0ce04006-7f57-47ac-bad5-3c7a0d1b5f87 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:39:26.921678 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-0ce04006-7f57-47ac-bad5-3c7a0d1b5f87 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] [instance: 476fd575-4b38-4ab0-aa32-b7ea9f67c0ff] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:39:26.932859 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-0ce04006-7f57-47ac-bad5-3c7a0d1b5f87 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:39:26.933679 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-0ce04006-7f57-47ac-bad5-3c7a0d1b5f87 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:39:26.935009 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-0ce04006-7f57-47ac-bad5-3c7a0d1b5f87 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:39:26.935716 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-0ce04006-7f57-47ac-bad5-3c7a0d1b5f87 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:39:27.180026 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-0ce04006-7f57-47ac-bad5-3c7a0d1b5f87 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebdf8e3cd1b44dcba37cdcfb4af7db2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a8e1d26bdfc400ebd1e070b09db615e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:39:27.191579 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-0ce04006-7f57-47ac-bad5-3c7a0d1b5f87 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] 10.222.0.30 "GET /compute/v2.1/servers/476fd575-4b38-4ab0-aa32-b7ea9f67c0ff" status: 200 len: 1672 microversion: 2.1 time: 0.276104 Jun 16 18:39:27.192571 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 439/913] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:39:26 2022] GET /compute/v2.1/servers/476fd575-4b38-4ab0-aa32-b7ea9f67c0ff => generated 1672 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:39:28.216040 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-11501940-9043-4954-8c41-fa43207eadda tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:39:28.217222 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-11501940-9043-4954-8c41-fa43207eadda tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] [instance: 476fd575-4b38-4ab0-aa32-b7ea9f67c0ff] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:39:28.229421 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-11501940-9043-4954-8c41-fa43207eadda tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:39:28.230268 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-11501940-9043-4954-8c41-fa43207eadda tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:39:28.231999 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-11501940-9043-4954-8c41-fa43207eadda tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:39:28.233055 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-11501940-9043-4954-8c41-fa43207eadda tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:39:28.600456 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-11501940-9043-4954-8c41-fa43207eadda tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebdf8e3cd1b44dcba37cdcfb4af7db2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a8e1d26bdfc400ebd1e070b09db615e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:39:28.629535 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-11501940-9043-4954-8c41-fa43207eadda tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] 10.222.0.30 "GET /compute/v2.1/servers/476fd575-4b38-4ab0-aa32-b7ea9f67c0ff" status: 200 len: 1672 microversion: 2.1 time: 0.421675 Jun 16 18:39:28.631474 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 475/914] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:39:28 2022] GET /compute/v2.1/servers/476fd575-4b38-4ab0-aa32-b7ea9f67c0ff => generated 1672 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:39:29.662342 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-9b0d0da8-bcaa-4155-81bd-0c5a36e05253 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:39:29.672395 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-9b0d0da8-bcaa-4155-81bd-0c5a36e05253 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] [instance: 476fd575-4b38-4ab0-aa32-b7ea9f67c0ff] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:39:29.681895 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG dbcounter [-] [117671] Writing DB stats nova_api:SELECT=31,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=117671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:39:29.691553 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-9b0d0da8-bcaa-4155-81bd-0c5a36e05253 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:39:29.692145 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-9b0d0da8-bcaa-4155-81bd-0c5a36e05253 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:39:29.693037 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-9b0d0da8-bcaa-4155-81bd-0c5a36e05253 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:39:29.693770 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-9b0d0da8-bcaa-4155-81bd-0c5a36e05253 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:39:29.723493 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG dbcounter [-] [117671] Writing DB stats nova_cell1:SELECT=70,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:39:29.785873 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-9b0d0da8-bcaa-4155-81bd-0c5a36e05253 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebdf8e3cd1b44dcba37cdcfb4af7db2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a8e1d26bdfc400ebd1e070b09db615e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:39:29.794537 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-9b0d0da8-bcaa-4155-81bd-0c5a36e05253 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] 10.222.0.30 "GET /compute/v2.1/servers/476fd575-4b38-4ab0-aa32-b7ea9f67c0ff" status: 200 len: 1605 microversion: 2.1 time: 0.140839 Jun 16 18:39:29.808127 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 440/915] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:39:29 2022] GET /compute/v2.1/servers/476fd575-4b38-4ab0-aa32-b7ea9f67c0ff => generated 1605 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:39:30.127818 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [req-89d65826-9deb-4cb0-907c-6b5b802ddcf9 req-1d62c907-1c09-47e0-8eb2-cd86d3a5ed65 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "476fd575-4b38-4ab0-aa32-b7ea9f67c0ff", "name": "network-vif-deleted", "tag": "a9232a51-386a-40f9-afa6-6e6866dfac4b"}]} {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:39:30.138523 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG dbcounter [-] [117670] Writing DB stats nova_api:SELECT=32,nova_api:UPDATE=1 {{(pid=117670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:39:30.156653 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [req-89d65826-9deb-4cb0-907c-6b5b802ddcf9 req-1d62c907-1c09-47e0-8eb2-cd86d3a5ed65 service nova] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:39:30.157938 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [req-89d65826-9deb-4cb0-907c-6b5b802ddcf9 req-1d62c907-1c09-47e0-8eb2-cd86d3a5ed65 service nova] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:39:30.167016 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG dbcounter [-] [117670] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=3,nova_cell1:INSERT=4 {{(pid=117670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:39:30.453536 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.compute.server_external_events [req-89d65826-9deb-4cb0-907c-6b5b802ddcf9 req-1d62c907-1c09-47e0-8eb2-cd86d3a5ed65 service nova] Creating event network-vif-deleted:a9232a51-386a-40f9-afa6-6e6866dfac4b for instance 476fd575-4b38-4ab0-aa32-b7ea9f67c0ff on hv-cinder-81322 Jun 16 18:39:30.465355 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [req-89d65826-9deb-4cb0-907c-6b5b802ddcf9 req-1d62c907-1c09-47e0-8eb2-cd86d3a5ed65 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.737730 Jun 16 18:39:30.467202 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 476/916] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Jun 16 18:39:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 18:39:30.824364 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-0b78a03b-cf11-42f3-9a8a-ba2039ae5d3d tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:39:30.828009 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-0b78a03b-cf11-42f3-9a8a-ba2039ae5d3d tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] [instance: 476fd575-4b38-4ab0-aa32-b7ea9f67c0ff] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:39:30.842279 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-0b78a03b-cf11-42f3-9a8a-ba2039ae5d3d tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:39:30.844006 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-0b78a03b-cf11-42f3-9a8a-ba2039ae5d3d tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:39:30.846031 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-0b78a03b-cf11-42f3-9a8a-ba2039ae5d3d tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:39:30.847076 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-0b78a03b-cf11-42f3-9a8a-ba2039ae5d3d tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:39:30.903588 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.wsgi [None req-0b78a03b-cf11-42f3-9a8a-ba2039ae5d3d tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] HTTP exception thrown: Instance 476fd575-4b38-4ab0-aa32-b7ea9f67c0ff could not be found. Jun 16 18:39:30.914667 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-0b78a03b-cf11-42f3-9a8a-ba2039ae5d3d tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Request method failure captured: Jun 16 18:39:30.914667 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: request: GET /compute/v2.1/servers/476fd575-4b38-4ab0-aa32-b7ea9f67c0ff HTTP/1.1 Jun 16 18:39:30.914667 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: Accept: application/json Jun 16 18:39:30.914667 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: Accept-Encoding: identity Jun 16 18:39:30.914667 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: Connection: close Jun 16 18:39:30.914667 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: Content-Length: 0 Jun 16 18:39:30.914667 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: Content-Type: application/json Jun 16 18:39:30.914667 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: Host: 10.222.0.30 Jun 16 18:39:30.914667 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: Openstack-System-Scope: None Jun 16 18:39:30.914667 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: User-Agent: python-urllib3/1.26.9 Jun 16 18:39:30.914667 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Auth-Token: gAAAAABiq3fCz_lfdO6bJNVO6BOUMdUJyD_mDnYFsrflkHu2X7_Q_EE66ihB233_CJeGX8VeIovBK-MdwX4QnFKy23zv0WlNnIm8wFu8aqA7k6kwZzdk_c6z39uXG3xWbYZzS3JBkESQwGgbmehb8LkLgx_C5HLfG3l93SCRo2fsRfSw5uj1YFM Jun 16 18:39:30.914667 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Domain-Id: None Jun 16 18:39:30.914667 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Domain-Name: None Jun 16 18:39:30.914667 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Identity-Status: Confirmed Jun 16 18:39:30.914667 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Is-Admin-Project: True Jun 16 18:39:30.914667 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Project-Domain-Id: default Jun 16 18:39:30.914667 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Project-Domain-Name: Default Jun 16 18:39:30.914667 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Project-Id: 7a8e1d26bdfc400ebd1e070b09db615e Jun 16 18:39:30.914667 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Project-Name: tempest-AttachVolumeTestJSON-1372713651 Jun 16 18:39:30.914667 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Role: reader,member Jun 16 18:39:30.914667 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Roles: reader,member Jun 16 18:39:30.917810 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/7a8e1d26bdfc400ebd1e070b09db615e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/7a8e1d26bdfc400ebd1e070b09db615e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_7a8e1d26bdfc400ebd1e070b09db615e", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/7a8e1d26bdfc400ebd1e070b09db615e"}]}] Jun 16 18:39:30.917810 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Tenant: tempest-AttachVolumeTestJSON-1372713651 Jun 16 18:39:30.917810 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Tenant-Id: 7a8e1d26bdfc400ebd1e070b09db615e Jun 16 18:39:30.917810 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1372713651 Jun 16 18:39:30.917810 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-User: tempest-AttachVolumeTestJSON-1372713651-project Jun 16 18:39:30.917810 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-User-Domain-Id: default Jun 16 18:39:30.917810 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-User-Domain-Name: Default Jun 16 18:39:30.917810 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-User-Id: ebdf8e3cd1b44dcba37cdcfb4af7db2b Jun 16 18:39:30.917810 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-User-Name: tempest-AttachVolumeTestJSON-1372713651-project Jun 16 18:39:30.917810 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: method: > Jun 16 18:39:30.917810 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: exception: Instance 476fd575-4b38-4ab0-aa32-b7ea9f67c0ff could not be found. Jun 16 18:39:30.917810 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: action_args: {'id': '476fd575-4b38-4ab0-aa32-b7ea9f67c0ff'} Jun 16 18:39:30.919691 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:39:30.919691 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:39:30.919691 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 18:39:30.919691 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 18:39:30.919691 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 18:39:30.919691 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 18:39:30.919691 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 18:39:30.919691 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 18:39:30.919691 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 18:39:30.919691 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 18:39:30.919691 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 476fd575-4b38-4ab0-aa32-b7ea9f67c0ff could not be found. Jun 16 18:39:30.919691 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi Jun 16 18:39:30.919691 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:39:30.919691 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi Jun 16 18:39:30.919691 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:39:30.919691 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:39:30.919691 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:39:30.919691 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:39:30.919691 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:39:30.919691 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:39:30.923132 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:39:30.923132 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 18:39:30.923132 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 18:39:30.923132 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 18:39:30.923132 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 18:39:30.923132 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 18:39:30.923132 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:39:30.923132 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 476fd575-4b38-4ab0-aa32-b7ea9f67c0ff could not be found. Jun 16 18:39:30.923132 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi Jun 16 18:39:30.923132 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:39:30.923132 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi Jun 16 18:39:30.923132 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:39:30.923132 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:39:30.923132 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:39:30.923132 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:39:30.923132 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:39:30.923132 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 476fd575-4b38-4ab0-aa32-b7ea9f67c0ff could not be found. Jun 16 18:39:30.923132 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi Jun 16 18:39:30.925660 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-0b78a03b-cf11-42f3-9a8a-ba2039ae5d3d tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Returning 404 to user: Instance 476fd575-4b38-4ab0-aa32-b7ea9f67c0ff could not be found. {{(pid=117670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:39:30.925660 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-0b78a03b-cf11-42f3-9a8a-ba2039ae5d3d tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] 10.222.0.30 "GET /compute/v2.1/servers/476fd575-4b38-4ab0-aa32-b7ea9f67c0ff" status: 404 len: 111 microversion: 2.1 time: 0.102817 Jun 16 18:39:30.925660 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 477/917] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:39:30 2022] GET /compute/v2.1/servers/476fd575-4b38-4ab0-aa32-b7ea9f67c0ff => generated 111 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:39:30.925914 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-36a4dff5-48de-4ad4-9207-32581e9865a9 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Action: 'create', calling method: .version_select at 0x7fbb23f5c5e0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1062823508", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCojwNV0A6/hE/OUBXNryYPpM9FJTlCdVQGm+Ekm749+b4Srl2Cpt1QUg9TCpKeA0nqBWyn++m660iVHQCpYyZLoMHqwB6/NJ8W4u4qARCQEodpRn6lqWnhsLC7sLKM8lw=="}} {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:39:30.935801 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-115e2e82-72d8-4191-9d54-eb0570d9b841 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Calling method '.version_select at 0x7fbb34649dc0>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:39:30.961238 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.quota [None req-36a4dff5-48de-4ad4-9207-32581e9865a9 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Getting quotas for project dff4784f6ab3499b88cb38c81780b754. Resources: {'key_pairs'} {{(pid=117671) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 18:39:30.968310 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-115e2e82-72d8-4191-9d54-eb0570d9b841 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-454788496" status: 202 len: 0 microversion: 2.1 time: 0.040972 Jun 16 18:39:30.969654 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 478/918] 10.222.0.30 () {58 vars in 1217 bytes} [Thu Jun 16 18:39:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-454788496 => generated 0 bytes in 44 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 18:39:30.977683 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.quota [None req-36a4dff5-48de-4ad4-9207-32581e9865a9 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Getting quotas for user e5cbf8d443de4a9fb627ef316fbd033f and project dff4784f6ab3499b88cb38c81780b754. Resources: {'key_pairs'} {{(pid=117671) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 18:39:31.038642 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-36a4dff5-48de-4ad4-9207-32581e9865a9 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.393262 Jun 16 18:39:31.040631 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 441/919] 10.222.0.30 () {60 vars in 1158 bytes} [Thu Jun 16 18:39:30 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:39:34.778675 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-e896a2ca-2410-41b3-9c11-c4262d2ad8a4 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:39:34.779513 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-e896a2ca-2410-41b3-9c11-c4262d2ad8a4 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] [instance: 476fd575-4b38-4ab0-aa32-b7ea9f67c0ff] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:39:34.788099 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-e896a2ca-2410-41b3-9c11-c4262d2ad8a4 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:39:34.788099 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-e896a2ca-2410-41b3-9c11-c4262d2ad8a4 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:39:34.788984 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-e896a2ca-2410-41b3-9c11-c4262d2ad8a4 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:39:34.789439 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-e896a2ca-2410-41b3-9c11-c4262d2ad8a4 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:39:34.813766 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.wsgi [None req-e896a2ca-2410-41b3-9c11-c4262d2ad8a4 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] HTTP exception thrown: Instance 476fd575-4b38-4ab0-aa32-b7ea9f67c0ff could not be found. Jun 16 18:39:34.817707 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-e896a2ca-2410-41b3-9c11-c4262d2ad8a4 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Request method failure captured: Jun 16 18:39:34.817707 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: request: DELETE /compute/v2.1/servers/476fd575-4b38-4ab0-aa32-b7ea9f67c0ff HTTP/1.1 Jun 16 18:39:34.817707 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: Accept: application/json Jun 16 18:39:34.817707 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: Accept-Encoding: identity Jun 16 18:39:34.817707 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: Connection: close Jun 16 18:39:34.817707 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: Content-Length: 0 Jun 16 18:39:34.817707 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: Content-Type: application/json Jun 16 18:39:34.817707 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: Host: 10.222.0.30 Jun 16 18:39:34.817707 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: Openstack-System-Scope: None Jun 16 18:39:34.817707 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: User-Agent: python-urllib3/1.26.9 Jun 16 18:39:34.817707 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Auth-Token: gAAAAABiq3fCz_lfdO6bJNVO6BOUMdUJyD_mDnYFsrflkHu2X7_Q_EE66ihB233_CJeGX8VeIovBK-MdwX4QnFKy23zv0WlNnIm8wFu8aqA7k6kwZzdk_c6z39uXG3xWbYZzS3JBkESQwGgbmehb8LkLgx_C5HLfG3l93SCRo2fsRfSw5uj1YFM Jun 16 18:39:34.817707 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Domain-Id: None Jun 16 18:39:34.817707 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Domain-Name: None Jun 16 18:39:34.817707 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Identity-Status: Confirmed Jun 16 18:39:34.817707 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Is-Admin-Project: True Jun 16 18:39:34.817707 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Project-Domain-Id: default Jun 16 18:39:34.817707 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Project-Domain-Name: Default Jun 16 18:39:34.817707 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Project-Id: 7a8e1d26bdfc400ebd1e070b09db615e Jun 16 18:39:34.817707 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Project-Name: tempest-AttachVolumeTestJSON-1372713651 Jun 16 18:39:34.817707 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Role: reader,member Jun 16 18:39:34.817707 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Roles: reader,member Jun 16 18:39:34.820461 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/7a8e1d26bdfc400ebd1e070b09db615e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/7a8e1d26bdfc400ebd1e070b09db615e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_7a8e1d26bdfc400ebd1e070b09db615e", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/7a8e1d26bdfc400ebd1e070b09db615e"}]}] Jun 16 18:39:34.820461 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Tenant: tempest-AttachVolumeTestJSON-1372713651 Jun 16 18:39:34.820461 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Tenant-Id: 7a8e1d26bdfc400ebd1e070b09db615e Jun 16 18:39:34.820461 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1372713651 Jun 16 18:39:34.820461 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-User: tempest-AttachVolumeTestJSON-1372713651-project Jun 16 18:39:34.820461 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-User-Domain-Id: default Jun 16 18:39:34.820461 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-User-Domain-Name: Default Jun 16 18:39:34.820461 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-User-Id: ebdf8e3cd1b44dcba37cdcfb4af7db2b Jun 16 18:39:34.820461 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-User-Name: tempest-AttachVolumeTestJSON-1372713651-project Jun 16 18:39:34.820461 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: method: > Jun 16 18:39:34.820461 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: exception: Instance 476fd575-4b38-4ab0-aa32-b7ea9f67c0ff could not be found. Jun 16 18:39:34.820461 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: action_args: {'id': '476fd575-4b38-4ab0-aa32-b7ea9f67c0ff'} Jun 16 18:39:34.821916 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:39:34.821916 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:39:34.821916 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 18:39:34.821916 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 18:39:34.821916 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 18:39:34.821916 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 18:39:34.821916 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 18:39:34.821916 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 18:39:34.821916 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 18:39:34.821916 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 18:39:34.821916 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 476fd575-4b38-4ab0-aa32-b7ea9f67c0ff could not be found. Jun 16 18:39:34.821916 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi Jun 16 18:39:34.821916 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:39:34.821916 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi Jun 16 18:39:34.821916 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:39:34.821916 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:39:34.821916 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:39:34.821916 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:39:34.821916 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:39:34.821916 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:39:34.824526 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:39:34.824526 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 16 18:39:34.824526 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 16 18:39:34.824526 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 16 18:39:34.824526 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 16 18:39:34.824526 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 18:39:34.824526 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 18:39:34.824526 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 18:39:34.824526 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:39:34.824526 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 476fd575-4b38-4ab0-aa32-b7ea9f67c0ff could not be found. Jun 16 18:39:34.824526 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi Jun 16 18:39:34.824526 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:39:34.824526 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi Jun 16 18:39:34.824526 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:39:34.824526 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:39:34.824526 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:39:34.824526 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:39:34.824526 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:39:34.824526 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 476fd575-4b38-4ab0-aa32-b7ea9f67c0ff could not be found. Jun 16 18:39:34.824526 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi Jun 16 18:39:34.827269 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-e896a2ca-2410-41b3-9c11-c4262d2ad8a4 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Returning 404 to user: Instance 476fd575-4b38-4ab0-aa32-b7ea9f67c0ff could not be found. {{(pid=117670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:39:34.827269 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-e896a2ca-2410-41b3-9c11-c4262d2ad8a4 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] 10.222.0.30 "DELETE /compute/v2.1/servers/476fd575-4b38-4ab0-aa32-b7ea9f67c0ff" status: 404 len: 111 microversion: 2.1 time: 0.046928 Jun 16 18:39:34.827269 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 479/920] 10.222.0.30 () {58 vars in 1238 bytes} [Thu Jun 16 18:39:34 2022] DELETE /compute/v2.1/servers/476fd575-4b38-4ab0-aa32-b7ea9f67c0ff => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 16 18:39:34.834750 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-9c454f37-7cbc-4a61-838e-d96493d2b27f tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:39:34.835929 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-9c454f37-7cbc-4a61-838e-d96493d2b27f tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] [instance: 476fd575-4b38-4ab0-aa32-b7ea9f67c0ff] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:39:34.852462 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-9c454f37-7cbc-4a61-838e-d96493d2b27f tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:39:34.853149 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-9c454f37-7cbc-4a61-838e-d96493d2b27f tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:39:34.854152 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-9c454f37-7cbc-4a61-838e-d96493d2b27f tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:39:34.854716 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-9c454f37-7cbc-4a61-838e-d96493d2b27f tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:39:34.880307 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.wsgi [None req-9c454f37-7cbc-4a61-838e-d96493d2b27f tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] HTTP exception thrown: Instance 476fd575-4b38-4ab0-aa32-b7ea9f67c0ff could not be found. Jun 16 18:39:34.882257 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-9c454f37-7cbc-4a61-838e-d96493d2b27f tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Request method failure captured: Jun 16 18:39:34.882257 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: request: GET /compute/v2.1/servers/476fd575-4b38-4ab0-aa32-b7ea9f67c0ff HTTP/1.1 Jun 16 18:39:34.882257 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: Accept: application/json Jun 16 18:39:34.882257 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: Accept-Encoding: identity Jun 16 18:39:34.882257 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: Connection: close Jun 16 18:39:34.882257 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: Content-Length: 0 Jun 16 18:39:34.882257 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: Content-Type: application/json Jun 16 18:39:34.882257 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: Host: 10.222.0.30 Jun 16 18:39:34.882257 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: Openstack-System-Scope: None Jun 16 18:39:34.882257 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: User-Agent: python-urllib3/1.26.9 Jun 16 18:39:34.882257 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Auth-Token: gAAAAABiq3fCz_lfdO6bJNVO6BOUMdUJyD_mDnYFsrflkHu2X7_Q_EE66ihB233_CJeGX8VeIovBK-MdwX4QnFKy23zv0WlNnIm8wFu8aqA7k6kwZzdk_c6z39uXG3xWbYZzS3JBkESQwGgbmehb8LkLgx_C5HLfG3l93SCRo2fsRfSw5uj1YFM Jun 16 18:39:34.882257 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Domain-Id: None Jun 16 18:39:34.882257 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Domain-Name: None Jun 16 18:39:34.882257 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Identity-Status: Confirmed Jun 16 18:39:34.882257 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Is-Admin-Project: True Jun 16 18:39:34.882257 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Project-Domain-Id: default Jun 16 18:39:34.882257 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Project-Domain-Name: Default Jun 16 18:39:34.882257 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Project-Id: 7a8e1d26bdfc400ebd1e070b09db615e Jun 16 18:39:34.882257 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Project-Name: tempest-AttachVolumeTestJSON-1372713651 Jun 16 18:39:34.882257 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Role: reader,member Jun 16 18:39:34.882257 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Roles: reader,member Jun 16 18:39:34.884961 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/7a8e1d26bdfc400ebd1e070b09db615e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/7a8e1d26bdfc400ebd1e070b09db615e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_7a8e1d26bdfc400ebd1e070b09db615e", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/7a8e1d26bdfc400ebd1e070b09db615e"}]}] Jun 16 18:39:34.884961 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Tenant: tempest-AttachVolumeTestJSON-1372713651 Jun 16 18:39:34.884961 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Tenant-Id: 7a8e1d26bdfc400ebd1e070b09db615e Jun 16 18:39:34.884961 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1372713651 Jun 16 18:39:34.884961 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-User: tempest-AttachVolumeTestJSON-1372713651-project Jun 16 18:39:34.884961 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-User-Domain-Id: default Jun 16 18:39:34.884961 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-User-Domain-Name: Default Jun 16 18:39:34.884961 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-User-Id: ebdf8e3cd1b44dcba37cdcfb4af7db2b Jun 16 18:39:34.884961 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-User-Name: tempest-AttachVolumeTestJSON-1372713651-project Jun 16 18:39:34.884961 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: method: > Jun 16 18:39:34.884961 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: exception: Instance 476fd575-4b38-4ab0-aa32-b7ea9f67c0ff could not be found. Jun 16 18:39:34.884961 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: action_args: {'id': '476fd575-4b38-4ab0-aa32-b7ea9f67c0ff'} Jun 16 18:39:34.886378 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:39:34.886378 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:39:34.886378 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 18:39:34.886378 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 18:39:34.886378 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 18:39:34.886378 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 18:39:34.886378 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 18:39:34.886378 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 18:39:34.886378 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 18:39:34.886378 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 18:39:34.886378 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 476fd575-4b38-4ab0-aa32-b7ea9f67c0ff could not be found. Jun 16 18:39:34.886378 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Jun 16 18:39:34.886378 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:39:34.886378 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Jun 16 18:39:34.886378 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:39:34.886378 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:39:34.886378 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:39:34.886378 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:39:34.886378 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:39:34.886378 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:39:34.890355 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:39:34.890355 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 18:39:34.890355 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 18:39:34.890355 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 18:39:34.890355 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 18:39:34.890355 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 18:39:34.890355 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:39:34.890355 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 476fd575-4b38-4ab0-aa32-b7ea9f67c0ff could not be found. Jun 16 18:39:34.890355 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Jun 16 18:39:34.890355 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:39:34.890355 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Jun 16 18:39:34.890355 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:39:34.890355 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:39:34.890355 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:39:34.890355 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:39:34.890355 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:39:34.890355 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 476fd575-4b38-4ab0-aa32-b7ea9f67c0ff could not be found. Jun 16 18:39:34.890355 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Jun 16 18:39:34.893974 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-9c454f37-7cbc-4a61-838e-d96493d2b27f tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Returning 404 to user: Instance 476fd575-4b38-4ab0-aa32-b7ea9f67c0ff could not be found. {{(pid=117671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:39:34.893974 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-9c454f37-7cbc-4a61-838e-d96493d2b27f tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] 10.222.0.30 "GET /compute/v2.1/servers/476fd575-4b38-4ab0-aa32-b7ea9f67c0ff" status: 404 len: 111 microversion: 2.1 time: 0.055517 Jun 16 18:39:34.893974 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 442/921] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:39:34 2022] GET /compute/v2.1/servers/476fd575-4b38-4ab0-aa32-b7ea9f67c0ff => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:39:36.106170 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-82842e1a-8295-4498-b08a-57a65fadfe65 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:39:36.106783 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-82842e1a-8295-4498-b08a-57a65fadfe65 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] [instance: f116c8d4-a63e-47e1-bb50-ec64f735bfcc] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:39:36.114951 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-82842e1a-8295-4498-b08a-57a65fadfe65 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:39:36.115716 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-82842e1a-8295-4498-b08a-57a65fadfe65 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:39:36.116929 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-82842e1a-8295-4498-b08a-57a65fadfe65 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:39:36.117530 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-82842e1a-8295-4498-b08a-57a65fadfe65 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:39:36.135968 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.wsgi [None req-82842e1a-8295-4498-b08a-57a65fadfe65 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] HTTP exception thrown: Instance f116c8d4-a63e-47e1-bb50-ec64f735bfcc could not be found. Jun 16 18:39:36.137769 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-82842e1a-8295-4498-b08a-57a65fadfe65 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Request method failure captured: Jun 16 18:39:36.137769 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: request: DELETE /compute/v2.1/servers/f116c8d4-a63e-47e1-bb50-ec64f735bfcc HTTP/1.1 Jun 16 18:39:36.137769 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: Accept: application/json Jun 16 18:39:36.137769 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: Accept-Encoding: identity Jun 16 18:39:36.137769 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: Connection: close Jun 16 18:39:36.137769 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: Content-Length: 0 Jun 16 18:39:36.137769 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: Content-Type: application/json Jun 16 18:39:36.137769 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: Host: 10.222.0.30 Jun 16 18:39:36.137769 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: Openstack-System-Scope: None Jun 16 18:39:36.137769 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: User-Agent: python-urllib3/1.26.9 Jun 16 18:39:36.137769 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Auth-Token: gAAAAABiq3fCz_lfdO6bJNVO6BOUMdUJyD_mDnYFsrflkHu2X7_Q_EE66ihB233_CJeGX8VeIovBK-MdwX4QnFKy23zv0WlNnIm8wFu8aqA7k6kwZzdk_c6z39uXG3xWbYZzS3JBkESQwGgbmehb8LkLgx_C5HLfG3l93SCRo2fsRfSw5uj1YFM Jun 16 18:39:36.137769 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Domain-Id: None Jun 16 18:39:36.137769 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Domain-Name: None Jun 16 18:39:36.137769 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Identity-Status: Confirmed Jun 16 18:39:36.137769 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Is-Admin-Project: True Jun 16 18:39:36.137769 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Project-Domain-Id: default Jun 16 18:39:36.137769 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Project-Domain-Name: Default Jun 16 18:39:36.137769 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Project-Id: 7a8e1d26bdfc400ebd1e070b09db615e Jun 16 18:39:36.137769 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Project-Name: tempest-AttachVolumeTestJSON-1372713651 Jun 16 18:39:36.137769 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Role: reader,member Jun 16 18:39:36.137769 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Roles: reader,member Jun 16 18:39:36.140653 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/7a8e1d26bdfc400ebd1e070b09db615e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/7a8e1d26bdfc400ebd1e070b09db615e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_7a8e1d26bdfc400ebd1e070b09db615e", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/7a8e1d26bdfc400ebd1e070b09db615e"}]}] Jun 16 18:39:36.140653 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Tenant: tempest-AttachVolumeTestJSON-1372713651 Jun 16 18:39:36.140653 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Tenant-Id: 7a8e1d26bdfc400ebd1e070b09db615e Jun 16 18:39:36.140653 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1372713651 Jun 16 18:39:36.140653 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-User: tempest-AttachVolumeTestJSON-1372713651-project Jun 16 18:39:36.140653 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-User-Domain-Id: default Jun 16 18:39:36.140653 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-User-Domain-Name: Default Jun 16 18:39:36.140653 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-User-Id: ebdf8e3cd1b44dcba37cdcfb4af7db2b Jun 16 18:39:36.140653 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-User-Name: tempest-AttachVolumeTestJSON-1372713651-project Jun 16 18:39:36.140653 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: method: > Jun 16 18:39:36.140653 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: exception: Instance f116c8d4-a63e-47e1-bb50-ec64f735bfcc could not be found. Jun 16 18:39:36.140653 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: action_args: {'id': 'f116c8d4-a63e-47e1-bb50-ec64f735bfcc'} Jun 16 18:39:36.142069 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:39:36.142069 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:39:36.142069 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 18:39:36.142069 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 18:39:36.142069 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 18:39:36.142069 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 18:39:36.142069 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 18:39:36.142069 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 18:39:36.142069 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 18:39:36.142069 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 18:39:36.142069 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f116c8d4-a63e-47e1-bb50-ec64f735bfcc could not be found. Jun 16 18:39:36.142069 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi Jun 16 18:39:36.142069 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:39:36.142069 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi Jun 16 18:39:36.142069 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:39:36.142069 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:39:36.142069 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:39:36.142069 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:39:36.142069 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:39:36.142069 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:39:36.144340 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:39:36.144340 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 16 18:39:36.144340 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 16 18:39:36.144340 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 16 18:39:36.144340 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 16 18:39:36.144340 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 18:39:36.144340 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 18:39:36.144340 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 18:39:36.144340 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:39:36.144340 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f116c8d4-a63e-47e1-bb50-ec64f735bfcc could not be found. Jun 16 18:39:36.144340 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi Jun 16 18:39:36.144340 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:39:36.144340 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi Jun 16 18:39:36.144340 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:39:36.144340 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:39:36.144340 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:39:36.144340 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:39:36.144340 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:39:36.144340 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f116c8d4-a63e-47e1-bb50-ec64f735bfcc could not be found. Jun 16 18:39:36.144340 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi Jun 16 18:39:36.146659 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-82842e1a-8295-4498-b08a-57a65fadfe65 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Returning 404 to user: Instance f116c8d4-a63e-47e1-bb50-ec64f735bfcc could not be found. {{(pid=117670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:39:36.146659 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-82842e1a-8295-4498-b08a-57a65fadfe65 tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] 10.222.0.30 "DELETE /compute/v2.1/servers/f116c8d4-a63e-47e1-bb50-ec64f735bfcc" status: 404 len: 111 microversion: 2.1 time: 0.038117 Jun 16 18:39:36.146659 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 480/922] 10.222.0.30 () {58 vars in 1238 bytes} [Thu Jun 16 18:39:36 2022] DELETE /compute/v2.1/servers/f116c8d4-a63e-47e1-bb50-ec64f735bfcc => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:39:36.151859 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-842df695-a3e4-4d36-8535-2d643faa221b tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:39:36.152602 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-842df695-a3e4-4d36-8535-2d643faa221b tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] [instance: f116c8d4-a63e-47e1-bb50-ec64f735bfcc] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:39:36.160886 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-842df695-a3e4-4d36-8535-2d643faa221b tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:39:36.161312 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-842df695-a3e4-4d36-8535-2d643faa221b tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:39:36.162425 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-842df695-a3e4-4d36-8535-2d643faa221b tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:39:36.162876 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-842df695-a3e4-4d36-8535-2d643faa221b tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:39:36.180171 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.wsgi [None req-842df695-a3e4-4d36-8535-2d643faa221b tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] HTTP exception thrown: Instance f116c8d4-a63e-47e1-bb50-ec64f735bfcc could not be found. Jun 16 18:39:36.181952 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-842df695-a3e4-4d36-8535-2d643faa221b tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Request method failure captured: Jun 16 18:39:36.181952 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: request: GET /compute/v2.1/servers/f116c8d4-a63e-47e1-bb50-ec64f735bfcc HTTP/1.1 Jun 16 18:39:36.181952 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: Accept: application/json Jun 16 18:39:36.181952 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: Accept-Encoding: identity Jun 16 18:39:36.181952 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: Connection: close Jun 16 18:39:36.181952 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: Content-Length: 0 Jun 16 18:39:36.181952 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: Content-Type: application/json Jun 16 18:39:36.181952 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: Host: 10.222.0.30 Jun 16 18:39:36.181952 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: Openstack-System-Scope: None Jun 16 18:39:36.181952 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: User-Agent: python-urllib3/1.26.9 Jun 16 18:39:36.181952 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Auth-Token: gAAAAABiq3fCz_lfdO6bJNVO6BOUMdUJyD_mDnYFsrflkHu2X7_Q_EE66ihB233_CJeGX8VeIovBK-MdwX4QnFKy23zv0WlNnIm8wFu8aqA7k6kwZzdk_c6z39uXG3xWbYZzS3JBkESQwGgbmehb8LkLgx_C5HLfG3l93SCRo2fsRfSw5uj1YFM Jun 16 18:39:36.181952 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Domain-Id: None Jun 16 18:39:36.181952 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Domain-Name: None Jun 16 18:39:36.181952 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Identity-Status: Confirmed Jun 16 18:39:36.181952 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Is-Admin-Project: True Jun 16 18:39:36.181952 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Project-Domain-Id: default Jun 16 18:39:36.181952 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Project-Domain-Name: Default Jun 16 18:39:36.181952 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Project-Id: 7a8e1d26bdfc400ebd1e070b09db615e Jun 16 18:39:36.181952 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Project-Name: tempest-AttachVolumeTestJSON-1372713651 Jun 16 18:39:36.181952 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Role: reader,member Jun 16 18:39:36.181952 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Roles: reader,member Jun 16 18:39:36.184506 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/7a8e1d26bdfc400ebd1e070b09db615e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/7a8e1d26bdfc400ebd1e070b09db615e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_7a8e1d26bdfc400ebd1e070b09db615e", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/7a8e1d26bdfc400ebd1e070b09db615e"}]}] Jun 16 18:39:36.184506 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Tenant: tempest-AttachVolumeTestJSON-1372713651 Jun 16 18:39:36.184506 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Tenant-Id: 7a8e1d26bdfc400ebd1e070b09db615e Jun 16 18:39:36.184506 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1372713651 Jun 16 18:39:36.184506 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-User: tempest-AttachVolumeTestJSON-1372713651-project Jun 16 18:39:36.184506 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-User-Domain-Id: default Jun 16 18:39:36.184506 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-User-Domain-Name: Default Jun 16 18:39:36.184506 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-User-Id: ebdf8e3cd1b44dcba37cdcfb4af7db2b Jun 16 18:39:36.184506 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-User-Name: tempest-AttachVolumeTestJSON-1372713651-project Jun 16 18:39:36.184506 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: method: > Jun 16 18:39:36.184506 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: exception: Instance f116c8d4-a63e-47e1-bb50-ec64f735bfcc could not be found. Jun 16 18:39:36.184506 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: action_args: {'id': 'f116c8d4-a63e-47e1-bb50-ec64f735bfcc'} Jun 16 18:39:36.185909 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:39:36.185909 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:39:36.185909 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 18:39:36.185909 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 18:39:36.185909 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 18:39:36.185909 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 18:39:36.185909 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 18:39:36.185909 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 18:39:36.185909 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 18:39:36.185909 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 18:39:36.185909 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f116c8d4-a63e-47e1-bb50-ec64f735bfcc could not be found. Jun 16 18:39:36.185909 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Jun 16 18:39:36.185909 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:39:36.185909 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Jun 16 18:39:36.185909 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:39:36.185909 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:39:36.185909 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:39:36.185909 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:39:36.185909 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:39:36.185909 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:39:36.189001 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:39:36.189001 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 18:39:36.189001 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 18:39:36.189001 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 18:39:36.189001 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 18:39:36.189001 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 18:39:36.189001 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:39:36.189001 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f116c8d4-a63e-47e1-bb50-ec64f735bfcc could not be found. Jun 16 18:39:36.189001 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Jun 16 18:39:36.189001 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:39:36.189001 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Jun 16 18:39:36.189001 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:39:36.189001 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:39:36.189001 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:39:36.189001 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:39:36.189001 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:39:36.189001 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f116c8d4-a63e-47e1-bb50-ec64f735bfcc could not be found. Jun 16 18:39:36.189001 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Jun 16 18:39:36.191110 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-842df695-a3e4-4d36-8535-2d643faa221b tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] Returning 404 to user: Instance f116c8d4-a63e-47e1-bb50-ec64f735bfcc could not be found. {{(pid=117671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:39:36.191110 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-842df695-a3e4-4d36-8535-2d643faa221b tempest-AttachVolumeTestJSON-1372713651 tempest-AttachVolumeTestJSON-1372713651-project] 10.222.0.30 "GET /compute/v2.1/servers/f116c8d4-a63e-47e1-bb50-ec64f735bfcc" status: 404 len: 111 microversion: 2.1 time: 0.036466 Jun 16 18:39:36.191110 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 443/923] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:39:36 2022] GET /compute/v2.1/servers/f116c8d4-a63e-47e1-bb50-ec64f735bfcc => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:39:48.092076 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-d0370791-bd18-4446-8e32-8c4bf71ef443 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1742210818", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1062823508", "security_groups": [{"name": "tempest-secgroup-smoke-1290455754"}], "block_device_mapping_v2": [{"uuid": "6ae275ac-3f9a-48bb-9fd1-d2a32027967c", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "b0cbaebd-d55a-4d35-baec-5307687a93e6"}]}} {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:39:48.108909 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG dbcounter [-] [117670] Writing DB stats nova_api:SELECT=10,nova_api:DELETE=1 {{(pid=117670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:39:48.109756 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG dbcounter [-] [117670] Writing DB stats nova_cell1:SELECT=7 {{(pid=117670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:39:48.245459 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.network.neutron [None req-d0370791-bd18-4446-8e32-8c4bf71ef443 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] validate_networks() for [('b0cbaebd-d55a-4d35-baec-5307687a93e6', None, None, None, None, None)] {{(pid=117670) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 18:39:48.872972 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.virt.hardware [None req-d0370791-bd18-4446-8e32-8c4bf71ef443 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Flavor limits 0:0:0 {{(pid=117670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 18:39:48.874888 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.virt.hardware [None req-d0370791-bd18-4446-8e32-8c4bf71ef443 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Image limits 0:0:0 {{(pid=117670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 18:39:48.876493 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.virt.hardware [None req-d0370791-bd18-4446-8e32-8c4bf71ef443 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Flavor pref 0:0:0 {{(pid=117670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 18:39:48.877706 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.virt.hardware [None req-d0370791-bd18-4446-8e32-8c4bf71ef443 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Image pref 0:0:0 {{(pid=117670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 18:39:48.878485 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.virt.hardware [None req-d0370791-bd18-4446-8e32-8c4bf71ef443 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 18:39:48.896943 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-d0370791-bd18-4446-8e32-8c4bf71ef443 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:39:48.897708 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-d0370791-bd18-4446-8e32-8c4bf71ef443 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:39:48.899188 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-d0370791-bd18-4446-8e32-8c4bf71ef443 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:39:48.899962 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-d0370791-bd18-4446-8e32-8c4bf71ef443 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:39:48.941970 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.quota [None req-d0370791-bd18-4446-8e32-8c4bf71ef443 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Getting quotas for project dff4784f6ab3499b88cb38c81780b754. Resources: {'instances', 'ram', 'cores'} {{(pid=117670) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 18:39:48.949380 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.quota [None req-d0370791-bd18-4446-8e32-8c4bf71ef443 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Getting quotas for user e5cbf8d443de4a9fb627ef316fbd033f and project dff4784f6ab3499b88cb38c81780b754. Resources: {'instances', 'ram', 'cores'} {{(pid=117670) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 18:39:49.046121 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-d0370791-bd18-4446-8e32-8c4bf71ef443 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Going to run 1 instances... {{(pid=117670) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 18:39:49.048594 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-d0370791-bd18-4446-8e32-8c4bf71ef443 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] [instance: d7463e71-d7d9-406e-97b0-5ab1dc992c9b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='6ae275ac-3f9a-48bb-9fd1-d2a32027967c',volume_size=None,volume_type=None)] {{(pid=117670) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 18:39:49.238305 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-d0370791-bd18-4446-8e32-8c4bf71ef443 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.150554 Jun 16 18:39:49.240160 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 481/924] 10.222.0.30 () {60 vars in 1146 bytes} [Thu Jun 16 18:39:48 2022] POST /compute/v2.1/servers => generated 406 bytes in 1153 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 18:39:49.261774 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-20e79fbe-3ff5-44a1-acc9-c1b957e308c8 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:39:49.265166 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-20e79fbe-3ff5-44a1-acc9-c1b957e308c8 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] [instance: d7463e71-d7d9-406e-97b0-5ab1dc992c9b] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:39:49.271561 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG dbcounter [-] [117671] Writing DB stats nova_cell0:SELECT=4 {{(pid=117671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:39:49.273220 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG dbcounter [-] [117671] Writing DB stats nova_api:SELECT=16,nova_api:INSERT=1 {{(pid=117671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:39:49.274023 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG dbcounter [-] [117671] Writing DB stats nova_cell1:SELECT=9 {{(pid=117671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:39:49.368790 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-20e79fbe-3ff5-44a1-acc9-c1b957e308c8 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5cbf8d443de4a9fb627ef316fbd033f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff4784f6ab3499b88cb38c81780b754', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:39:49.376747 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-20e79fbe-3ff5-44a1-acc9-c1b957e308c8 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] 10.222.0.30 "GET /compute/v2.1/servers/d7463e71-d7d9-406e-97b0-5ab1dc992c9b" status: 200 len: 1095 microversion: 2.1 time: 0.125537 Jun 16 18:39:49.378099 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 444/925] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:39:49 2022] GET /compute/v2.1/servers/d7463e71-d7d9-406e-97b0-5ab1dc992c9b => generated 1095 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:39:50.395241 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-22d4ccea-990b-4873-810c-da398d5aa645 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:39:50.397291 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-22d4ccea-990b-4873-810c-da398d5aa645 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] [instance: d7463e71-d7d9-406e-97b0-5ab1dc992c9b] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:39:50.406178 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-22d4ccea-990b-4873-810c-da398d5aa645 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:39:50.406565 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-22d4ccea-990b-4873-810c-da398d5aa645 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:39:50.407517 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-22d4ccea-990b-4873-810c-da398d5aa645 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:39:50.408038 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-22d4ccea-990b-4873-810c-da398d5aa645 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:39:50.481097 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-22d4ccea-990b-4873-810c-da398d5aa645 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5cbf8d443de4a9fb627ef316fbd033f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff4784f6ab3499b88cb38c81780b754', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:39:50.489867 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-22d4ccea-990b-4873-810c-da398d5aa645 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] 10.222.0.30 "GET /compute/v2.1/servers/d7463e71-d7d9-406e-97b0-5ab1dc992c9b" status: 200 len: 1193 microversion: 2.1 time: 0.099951 Jun 16 18:39:50.490908 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 482/926] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:39:50 2022] GET /compute/v2.1/servers/d7463e71-d7d9-406e-97b0-5ab1dc992c9b => generated 1193 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:39:51.512859 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-c898ddd8-b062-4e1f-8fdd-e4cd927edf11 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:39:51.514677 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-c898ddd8-b062-4e1f-8fdd-e4cd927edf11 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] [instance: d7463e71-d7d9-406e-97b0-5ab1dc992c9b] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:39:51.531268 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-c898ddd8-b062-4e1f-8fdd-e4cd927edf11 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:39:51.531825 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-c898ddd8-b062-4e1f-8fdd-e4cd927edf11 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:39:51.533012 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-c898ddd8-b062-4e1f-8fdd-e4cd927edf11 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:39:51.559848 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-c898ddd8-b062-4e1f-8fdd-e4cd927edf11 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:39:51.897999 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-c898ddd8-b062-4e1f-8fdd-e4cd927edf11 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5cbf8d443de4a9fb627ef316fbd033f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff4784f6ab3499b88cb38c81780b754', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:39:51.918440 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-c898ddd8-b062-4e1f-8fdd-e4cd927edf11 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] 10.222.0.30 "GET /compute/v2.1/servers/d7463e71-d7d9-406e-97b0-5ab1dc992c9b" status: 200 len: 1267 microversion: 2.1 time: 0.413635 Jun 16 18:39:51.919441 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 445/927] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:39:51 2022] GET /compute/v2.1/servers/d7463e71-d7d9-406e-97b0-5ab1dc992c9b => generated 1267 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:39:52.942899 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-28e157bb-cfe7-4976-ba05-78ce9e47a869 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:39:52.943860 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-28e157bb-cfe7-4976-ba05-78ce9e47a869 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] [instance: d7463e71-d7d9-406e-97b0-5ab1dc992c9b] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:39:52.974463 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-28e157bb-cfe7-4976-ba05-78ce9e47a869 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:39:52.975261 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-28e157bb-cfe7-4976-ba05-78ce9e47a869 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:39:52.976252 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-28e157bb-cfe7-4976-ba05-78ce9e47a869 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:39:52.977250 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-28e157bb-cfe7-4976-ba05-78ce9e47a869 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:39:53.212626 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [req-c8844f5e-14a8-4852-adb6-948586c1c450 req-5bd1f577-f63d-4c20-a8e6-c756e5b6c581 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d7463e71-d7d9-406e-97b0-5ab1dc992c9b", "tag": "fb36aaba-0fd0-42b5-b9ac-2f6112753d35"}]} {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:39:53.230988 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [req-c8844f5e-14a8-4852-adb6-948586c1c450 req-5bd1f577-f63d-4c20-a8e6-c756e5b6c581 service nova] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:39:53.231743 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [req-c8844f5e-14a8-4852-adb6-948586c1c450 req-5bd1f577-f63d-4c20-a8e6-c756e5b6c581 service nova] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:39:53.279046 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.compute.server_external_events [req-c8844f5e-14a8-4852-adb6-948586c1c450 req-5bd1f577-f63d-4c20-a8e6-c756e5b6c581 service nova] Creating event network-changed:fb36aaba-0fd0-42b5-b9ac-2f6112753d35 for instance d7463e71-d7d9-406e-97b0-5ab1dc992c9b on hv-cinder-81322 Jun 16 18:39:53.291114 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [req-c8844f5e-14a8-4852-adb6-948586c1c450 req-5bd1f577-f63d-4c20-a8e6-c756e5b6c581 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093739 Jun 16 18:39:53.292229 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 446/928] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Jun 16 18:39:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:39:53.567723 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-28e157bb-cfe7-4976-ba05-78ce9e47a869 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5cbf8d443de4a9fb627ef316fbd033f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff4784f6ab3499b88cb38c81780b754', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:39:53.578498 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-28e157bb-cfe7-4976-ba05-78ce9e47a869 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] 10.222.0.30 "GET /compute/v2.1/servers/d7463e71-d7d9-406e-97b0-5ab1dc992c9b" status: 200 len: 1267 microversion: 2.1 time: 0.639567 Jun 16 18:39:53.580271 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 483/929] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:39:52 2022] GET /compute/v2.1/servers/d7463e71-d7d9-406e-97b0-5ab1dc992c9b => generated 1267 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:39:54.607071 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-43f43f3d-f000-42c3-9e5f-ef5716641ac4 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:39:54.609816 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-43f43f3d-f000-42c3-9e5f-ef5716641ac4 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] [instance: d7463e71-d7d9-406e-97b0-5ab1dc992c9b] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:39:54.619802 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-43f43f3d-f000-42c3-9e5f-ef5716641ac4 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:39:54.621023 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-43f43f3d-f000-42c3-9e5f-ef5716641ac4 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:39:54.622778 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-43f43f3d-f000-42c3-9e5f-ef5716641ac4 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:39:54.624361 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-43f43f3d-f000-42c3-9e5f-ef5716641ac4 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:39:54.878455 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-43f43f3d-f000-42c3-9e5f-ef5716641ac4 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5cbf8d443de4a9fb627ef316fbd033f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff4784f6ab3499b88cb38c81780b754', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:39:54.886663 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-43f43f3d-f000-42c3-9e5f-ef5716641ac4 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] 10.222.0.30 "GET /compute/v2.1/servers/d7463e71-d7d9-406e-97b0-5ab1dc992c9b" status: 200 len: 1267 microversion: 2.1 time: 0.286860 Jun 16 18:39:54.896343 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 447/930] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:39:54 2022] GET /compute/v2.1/servers/d7463e71-d7d9-406e-97b0-5ab1dc992c9b => generated 1267 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:39:55.904042 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-4e18efaa-c315-4f5e-a33f-bbca7aa3ffec tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:39:55.905484 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-4e18efaa-c315-4f5e-a33f-bbca7aa3ffec tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] [instance: d7463e71-d7d9-406e-97b0-5ab1dc992c9b] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:39:55.914811 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-4e18efaa-c315-4f5e-a33f-bbca7aa3ffec tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:39:55.915340 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-4e18efaa-c315-4f5e-a33f-bbca7aa3ffec tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:39:55.916348 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-4e18efaa-c315-4f5e-a33f-bbca7aa3ffec tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:39:55.916899 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-4e18efaa-c315-4f5e-a33f-bbca7aa3ffec tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:39:56.129340 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-4e18efaa-c315-4f5e-a33f-bbca7aa3ffec tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5cbf8d443de4a9fb627ef316fbd033f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff4784f6ab3499b88cb38c81780b754', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:39:56.141510 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-4e18efaa-c315-4f5e-a33f-bbca7aa3ffec tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] 10.222.0.30 "GET /compute/v2.1/servers/d7463e71-d7d9-406e-97b0-5ab1dc992c9b" status: 200 len: 1267 microversion: 2.1 time: 0.241473 Jun 16 18:39:56.142638 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 484/931] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:39:55 2022] GET /compute/v2.1/servers/d7463e71-d7d9-406e-97b0-5ab1dc992c9b => generated 1267 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:39:57.161827 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-546a40e5-d9fe-422a-8ede-416d6d7a087e tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:39:57.162497 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-546a40e5-d9fe-422a-8ede-416d6d7a087e tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] [instance: d7463e71-d7d9-406e-97b0-5ab1dc992c9b] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:39:57.170858 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-546a40e5-d9fe-422a-8ede-416d6d7a087e tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:39:57.171556 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-546a40e5-d9fe-422a-8ede-416d6d7a087e tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:39:57.172592 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-546a40e5-d9fe-422a-8ede-416d6d7a087e tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:39:57.173119 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-546a40e5-d9fe-422a-8ede-416d6d7a087e tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:39:57.343280 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-546a40e5-d9fe-422a-8ede-416d6d7a087e tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5cbf8d443de4a9fb627ef316fbd033f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff4784f6ab3499b88cb38c81780b754', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:39:57.357209 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-546a40e5-d9fe-422a-8ede-416d6d7a087e tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] 10.222.0.30 "GET /compute/v2.1/servers/d7463e71-d7d9-406e-97b0-5ab1dc992c9b" status: 200 len: 1267 microversion: 2.1 time: 0.198790 Jun 16 18:39:57.358841 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 448/932] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:39:57 2022] GET /compute/v2.1/servers/d7463e71-d7d9-406e-97b0-5ab1dc992c9b => generated 1267 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:39:58.379875 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-f9e27add-bbaf-4629-954d-4af91239880f tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:39:58.380947 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-f9e27add-bbaf-4629-954d-4af91239880f tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] [instance: d7463e71-d7d9-406e-97b0-5ab1dc992c9b] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:39:58.392949 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-f9e27add-bbaf-4629-954d-4af91239880f tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:39:58.393630 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-f9e27add-bbaf-4629-954d-4af91239880f tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:39:58.394819 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-f9e27add-bbaf-4629-954d-4af91239880f tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:39:58.395484 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-f9e27add-bbaf-4629-954d-4af91239880f tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:39:58.558139 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-f9e27add-bbaf-4629-954d-4af91239880f tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5cbf8d443de4a9fb627ef316fbd033f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff4784f6ab3499b88cb38c81780b754', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:39:58.567175 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-f9e27add-bbaf-4629-954d-4af91239880f tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] 10.222.0.30 "GET /compute/v2.1/servers/d7463e71-d7d9-406e-97b0-5ab1dc992c9b" status: 200 len: 1267 microversion: 2.1 time: 0.193643 Jun 16 18:39:58.567823 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 485/933] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:39:58 2022] GET /compute/v2.1/servers/d7463e71-d7d9-406e-97b0-5ab1dc992c9b => generated 1267 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:39:59.585653 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-fd56d133-11c7-4cb3-8715-b2ddf96c3d97 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:39:59.586364 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-fd56d133-11c7-4cb3-8715-b2ddf96c3d97 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] [instance: d7463e71-d7d9-406e-97b0-5ab1dc992c9b] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:39:59.590222 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG dbcounter [-] [117671] Writing DB stats nova_cell0:SELECT=2 {{(pid=117671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:39:59.595108 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-fd56d133-11c7-4cb3-8715-b2ddf96c3d97 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:39:59.595564 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-fd56d133-11c7-4cb3-8715-b2ddf96c3d97 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:39:59.596393 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-fd56d133-11c7-4cb3-8715-b2ddf96c3d97 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:39:59.596837 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-fd56d133-11c7-4cb3-8715-b2ddf96c3d97 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:39:59.775564 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-fd56d133-11c7-4cb3-8715-b2ddf96c3d97 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5cbf8d443de4a9fb627ef316fbd033f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff4784f6ab3499b88cb38c81780b754', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:39:59.785466 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-fd56d133-11c7-4cb3-8715-b2ddf96c3d97 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] 10.222.0.30 "GET /compute/v2.1/servers/d7463e71-d7d9-406e-97b0-5ab1dc992c9b" status: 200 len: 1267 microversion: 2.1 time: 0.204149 Jun 16 18:39:59.786256 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 449/934] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:39:59 2022] GET /compute/v2.1/servers/d7463e71-d7d9-406e-97b0-5ab1dc992c9b => generated 1267 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:40:00.806104 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-589786a8-6d53-4f67-965f-7fe25567c864 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:40:00.806995 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-589786a8-6d53-4f67-965f-7fe25567c864 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] [instance: d7463e71-d7d9-406e-97b0-5ab1dc992c9b] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:40:00.809154 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG dbcounter [-] [117670] Writing DB stats nova_cell0:SELECT=2 {{(pid=117670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:40:00.810108 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG dbcounter [-] [117670] Writing DB stats nova_cell0:SELECT=6 {{(pid=117670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:40:00.819316 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-589786a8-6d53-4f67-965f-7fe25567c864 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:40:00.819848 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-589786a8-6d53-4f67-965f-7fe25567c864 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:40:00.820932 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-589786a8-6d53-4f67-965f-7fe25567c864 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:40:00.821695 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-589786a8-6d53-4f67-965f-7fe25567c864 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:40:01.014866 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-589786a8-6d53-4f67-965f-7fe25567c864 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5cbf8d443de4a9fb627ef316fbd033f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff4784f6ab3499b88cb38c81780b754', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:40:01.025320 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-589786a8-6d53-4f67-965f-7fe25567c864 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] 10.222.0.30 "GET /compute/v2.1/servers/d7463e71-d7d9-406e-97b0-5ab1dc992c9b" status: 200 len: 1267 microversion: 2.1 time: 0.224180 Jun 16 18:40:01.025916 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 486/935] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:40:00 2022] GET /compute/v2.1/servers/d7463e71-d7d9-406e-97b0-5ab1dc992c9b => generated 1267 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:40:02.050532 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-b740b724-13be-403e-a0f3-fa80f3502f94 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:40:02.051495 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-b740b724-13be-403e-a0f3-fa80f3502f94 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] [instance: d7463e71-d7d9-406e-97b0-5ab1dc992c9b] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:40:02.063134 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-b740b724-13be-403e-a0f3-fa80f3502f94 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:40:02.063927 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-b740b724-13be-403e-a0f3-fa80f3502f94 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:40:02.065282 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-b740b724-13be-403e-a0f3-fa80f3502f94 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:40:02.066058 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-b740b724-13be-403e-a0f3-fa80f3502f94 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:40:02.230009 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-b740b724-13be-403e-a0f3-fa80f3502f94 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5cbf8d443de4a9fb627ef316fbd033f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff4784f6ab3499b88cb38c81780b754', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:40:02.239032 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-b740b724-13be-403e-a0f3-fa80f3502f94 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] 10.222.0.30 "GET /compute/v2.1/servers/d7463e71-d7d9-406e-97b0-5ab1dc992c9b" status: 200 len: 1267 microversion: 2.1 time: 0.195876 Jun 16 18:40:02.239992 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 450/936] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:40:02 2022] GET /compute/v2.1/servers/d7463e71-d7d9-406e-97b0-5ab1dc992c9b => generated 1267 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:40:03.273788 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-f41f0f45-41c1-4ef8-b348-e05fa4a936e3 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:40:03.276975 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-f41f0f45-41c1-4ef8-b348-e05fa4a936e3 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] [instance: d7463e71-d7d9-406e-97b0-5ab1dc992c9b] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:40:03.290407 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-f41f0f45-41c1-4ef8-b348-e05fa4a936e3 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:40:03.291808 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-f41f0f45-41c1-4ef8-b348-e05fa4a936e3 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:40:03.293403 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-f41f0f45-41c1-4ef8-b348-e05fa4a936e3 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:40:03.294499 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-f41f0f45-41c1-4ef8-b348-e05fa4a936e3 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:40:03.584078 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-f41f0f45-41c1-4ef8-b348-e05fa4a936e3 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5cbf8d443de4a9fb627ef316fbd033f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff4784f6ab3499b88cb38c81780b754', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:40:03.594442 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-f41f0f45-41c1-4ef8-b348-e05fa4a936e3 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] 10.222.0.30 "GET /compute/v2.1/servers/d7463e71-d7d9-406e-97b0-5ab1dc992c9b" status: 200 len: 1267 microversion: 2.1 time: 0.329409 Jun 16 18:40:03.595313 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 487/937] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:40:03 2022] GET /compute/v2.1/servers/d7463e71-d7d9-406e-97b0-5ab1dc992c9b => generated 1267 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:40:04.613195 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-1b869609-8ed1-4662-92d5-5dc1f65c24a4 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:40:04.614081 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-1b869609-8ed1-4662-92d5-5dc1f65c24a4 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] [instance: d7463e71-d7d9-406e-97b0-5ab1dc992c9b] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:40:04.621330 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-1b869609-8ed1-4662-92d5-5dc1f65c24a4 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:40:04.621792 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-1b869609-8ed1-4662-92d5-5dc1f65c24a4 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:40:04.622644 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-1b869609-8ed1-4662-92d5-5dc1f65c24a4 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:40:04.623237 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-1b869609-8ed1-4662-92d5-5dc1f65c24a4 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:40:04.821728 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-1b869609-8ed1-4662-92d5-5dc1f65c24a4 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5cbf8d443de4a9fb627ef316fbd033f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff4784f6ab3499b88cb38c81780b754', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:40:04.831097 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-1b869609-8ed1-4662-92d5-5dc1f65c24a4 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] 10.222.0.30 "GET /compute/v2.1/servers/d7463e71-d7d9-406e-97b0-5ab1dc992c9b" status: 200 len: 1267 microversion: 2.1 time: 0.221987 Jun 16 18:40:04.832253 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 451/938] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:40:04 2022] GET /compute/v2.1/servers/d7463e71-d7d9-406e-97b0-5ab1dc992c9b => generated 1267 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:40:05.521461 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [req-d67d7a73-a0cf-406f-81cc-d85cead7a534 req-cebbac42-f401-4548-8972-8dbcc524bb65 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7463e71-d7d9-406e-97b0-5ab1dc992c9b", "name": "network-vif-plugged", "status": "completed", "tag": "fb36aaba-0fd0-42b5-b9ac-2f6112753d35"}]} {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:40:05.534673 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [req-d67d7a73-a0cf-406f-81cc-d85cead7a534 req-cebbac42-f401-4548-8972-8dbcc524bb65 service nova] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:40:05.535265 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [req-d67d7a73-a0cf-406f-81cc-d85cead7a534 req-cebbac42-f401-4548-8972-8dbcc524bb65 service nova] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:40:05.550689 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.compute.server_external_events [req-d67d7a73-a0cf-406f-81cc-d85cead7a534 req-cebbac42-f401-4548-8972-8dbcc524bb65 service nova] Creating event network-vif-plugged:fb36aaba-0fd0-42b5-b9ac-2f6112753d35 for instance d7463e71-d7d9-406e-97b0-5ab1dc992c9b on hv-cinder-81322 Jun 16 18:40:05.557039 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [req-d67d7a73-a0cf-406f-81cc-d85cead7a534 req-cebbac42-f401-4548-8972-8dbcc524bb65 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.219829 Jun 16 18:40:05.557835 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 488/939] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Jun 16 18:40:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:40:05.857363 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-78ac95d7-a4f0-43d5-868a-d68cdfee773b tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:40:05.859936 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-78ac95d7-a4f0-43d5-868a-d68cdfee773b tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] [instance: d7463e71-d7d9-406e-97b0-5ab1dc992c9b] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:40:05.874109 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-78ac95d7-a4f0-43d5-868a-d68cdfee773b tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:40:05.874919 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-78ac95d7-a4f0-43d5-868a-d68cdfee773b tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:40:05.877130 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-78ac95d7-a4f0-43d5-868a-d68cdfee773b tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:40:05.877858 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-78ac95d7-a4f0-43d5-868a-d68cdfee773b tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:40:06.104220 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-78ac95d7-a4f0-43d5-868a-d68cdfee773b tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5cbf8d443de4a9fb627ef316fbd033f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff4784f6ab3499b88cb38c81780b754', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:40:06.115189 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-78ac95d7-a4f0-43d5-868a-d68cdfee773b tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] 10.222.0.30 "GET /compute/v2.1/servers/d7463e71-d7d9-406e-97b0-5ab1dc992c9b" status: 200 len: 1267 microversion: 2.1 time: 0.261821 Jun 16 18:40:06.125207 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 452/940] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:40:05 2022] GET /compute/v2.1/servers/d7463e71-d7d9-406e-97b0-5ab1dc992c9b => generated 1267 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:40:07.137692 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-ab1631fb-ad96-476f-bc7b-c528bd5b6e76 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:40:07.138439 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-ab1631fb-ad96-476f-bc7b-c528bd5b6e76 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] [instance: d7463e71-d7d9-406e-97b0-5ab1dc992c9b] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:40:07.147342 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-ab1631fb-ad96-476f-bc7b-c528bd5b6e76 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:40:07.148121 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-ab1631fb-ad96-476f-bc7b-c528bd5b6e76 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:40:07.149808 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-ab1631fb-ad96-476f-bc7b-c528bd5b6e76 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:40:07.150587 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-ab1631fb-ad96-476f-bc7b-c528bd5b6e76 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:40:07.360603 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-ab1631fb-ad96-476f-bc7b-c528bd5b6e76 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5cbf8d443de4a9fb627ef316fbd033f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff4784f6ab3499b88cb38c81780b754', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:40:07.375364 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-ab1631fb-ad96-476f-bc7b-c528bd5b6e76 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] 10.222.0.30 "GET /compute/v2.1/servers/d7463e71-d7d9-406e-97b0-5ab1dc992c9b" status: 200 len: 1267 microversion: 2.1 time: 0.242162 Jun 16 18:40:07.376380 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 489/941] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:40:07 2022] GET /compute/v2.1/servers/d7463e71-d7d9-406e-97b0-5ab1dc992c9b => generated 1267 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:40:08.398405 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-6029ddf7-dd1c-4019-a6b3-308900c434f4 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:40:08.399187 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-6029ddf7-dd1c-4019-a6b3-308900c434f4 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] [instance: d7463e71-d7d9-406e-97b0-5ab1dc992c9b] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:40:08.407625 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-6029ddf7-dd1c-4019-a6b3-308900c434f4 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:40:08.408089 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-6029ddf7-dd1c-4019-a6b3-308900c434f4 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:40:08.409006 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-6029ddf7-dd1c-4019-a6b3-308900c434f4 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:40:08.409515 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-6029ddf7-dd1c-4019-a6b3-308900c434f4 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:40:08.572388 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-6029ddf7-dd1c-4019-a6b3-308900c434f4 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5cbf8d443de4a9fb627ef316fbd033f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff4784f6ab3499b88cb38c81780b754', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:40:08.581372 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-6029ddf7-dd1c-4019-a6b3-308900c434f4 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] 10.222.0.30 "GET /compute/v2.1/servers/d7463e71-d7d9-406e-97b0-5ab1dc992c9b" status: 200 len: 1455 microversion: 2.1 time: 0.187325 Jun 16 18:40:08.581979 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 453/942] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:40:08 2022] GET /compute/v2.1/servers/d7463e71-d7d9-406e-97b0-5ab1dc992c9b => generated 1455 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:40:08.601553 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-9ba9f6b1-80b0-44d4-9aad-0bcd3841897a tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:40:08.602651 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-9ba9f6b1-80b0-44d4-9aad-0bcd3841897a tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] [instance: d7463e71-d7d9-406e-97b0-5ab1dc992c9b] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:40:08.614687 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-9ba9f6b1-80b0-44d4-9aad-0bcd3841897a tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:40:08.615512 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-9ba9f6b1-80b0-44d4-9aad-0bcd3841897a tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:40:08.616891 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-9ba9f6b1-80b0-44d4-9aad-0bcd3841897a tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:40:08.617700 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-9ba9f6b1-80b0-44d4-9aad-0bcd3841897a tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:40:08.809049 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-9ba9f6b1-80b0-44d4-9aad-0bcd3841897a tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5cbf8d443de4a9fb627ef316fbd033f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff4784f6ab3499b88cb38c81780b754', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:40:08.819431 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-9ba9f6b1-80b0-44d4-9aad-0bcd3841897a tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] 10.222.0.30 "GET /compute/v2.1/servers/d7463e71-d7d9-406e-97b0-5ab1dc992c9b" status: 200 len: 1455 microversion: 2.1 time: 0.225015 Jun 16 18:40:08.820139 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 490/943] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:40:08 2022] GET /compute/v2.1/servers/d7463e71-d7d9-406e-97b0-5ab1dc992c9b => generated 1455 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:40:12.122306 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [req-7b64fcc6-b832-488b-b4e1-84cb47122af2 req-beecca8d-4fe3-4c3a-845a-16a27fb7dae5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d7463e71-d7d9-406e-97b0-5ab1dc992c9b", "tag": "fb36aaba-0fd0-42b5-b9ac-2f6112753d35"}]} {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:40:12.136589 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [req-7b64fcc6-b832-488b-b4e1-84cb47122af2 req-beecca8d-4fe3-4c3a-845a-16a27fb7dae5 service nova] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:40:12.137267 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [req-7b64fcc6-b832-488b-b4e1-84cb47122af2 req-beecca8d-4fe3-4c3a-845a-16a27fb7dae5 service nova] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:40:12.159743 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.compute.server_external_events [req-7b64fcc6-b832-488b-b4e1-84cb47122af2 req-beecca8d-4fe3-4c3a-845a-16a27fb7dae5 service nova] Creating event network-changed:fb36aaba-0fd0-42b5-b9ac-2f6112753d35 for instance d7463e71-d7d9-406e-97b0-5ab1dc992c9b on hv-cinder-81322 Jun 16 18:40:12.168701 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [req-7b64fcc6-b832-488b-b4e1-84cb47122af2 req-beecca8d-4fe3-4c3a-845a-16a27fb7dae5 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.418425 Jun 16 18:40:12.170794 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 454/944] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Jun 16 18:40:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:40:18.018787 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-c9e30a8b-19eb-4947-beaa-868eab5c8b48 tempest-VolumesSnapshotTestJSON-723812961 tempest-VolumesSnapshotTestJSON-723812961-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1431090055", "imageRef": "38ef083a-a9ff-4836-8954-f770268ba205", "flavorRef": "452", "networks": [{"uuid": "f9ae11bf-ea91-454f-9c1b-43afd598e56c"}]}} {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:40:18.077098 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.network.neutron [None req-c9e30a8b-19eb-4947-beaa-868eab5c8b48 tempest-VolumesSnapshotTestJSON-723812961 tempest-VolumesSnapshotTestJSON-723812961-project] validate_networks() for [('f9ae11bf-ea91-454f-9c1b-43afd598e56c', None, None, None, None, None)] {{(pid=117670) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 18:40:18.469535 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.virt.hardware [None req-c9e30a8b-19eb-4947-beaa-868eab5c8b48 tempest-VolumesSnapshotTestJSON-723812961 tempest-VolumesSnapshotTestJSON-723812961-project] Flavor limits 0:0:0 {{(pid=117670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 18:40:18.469958 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.virt.hardware [None req-c9e30a8b-19eb-4947-beaa-868eab5c8b48 tempest-VolumesSnapshotTestJSON-723812961 tempest-VolumesSnapshotTestJSON-723812961-project] Image limits 0:0:0 {{(pid=117670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 18:40:18.470429 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.virt.hardware [None req-c9e30a8b-19eb-4947-beaa-868eab5c8b48 tempest-VolumesSnapshotTestJSON-723812961 tempest-VolumesSnapshotTestJSON-723812961-project] Flavor pref 0:0:0 {{(pid=117670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 18:40:18.470841 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.virt.hardware [None req-c9e30a8b-19eb-4947-beaa-868eab5c8b48 tempest-VolumesSnapshotTestJSON-723812961 tempest-VolumesSnapshotTestJSON-723812961-project] Image pref 0:0:0 {{(pid=117670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 18:40:18.471251 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.virt.hardware [None req-c9e30a8b-19eb-4947-beaa-868eab5c8b48 tempest-VolumesSnapshotTestJSON-723812961 tempest-VolumesSnapshotTestJSON-723812961-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 18:40:18.473415 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG dbcounter [-] [117670] Writing DB stats nova_api:SELECT=36,nova_api:INSERT=3 {{(pid=117670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:40:18.484105 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-c9e30a8b-19eb-4947-beaa-868eab5c8b48 tempest-VolumesSnapshotTestJSON-723812961 tempest-VolumesSnapshotTestJSON-723812961-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:40:18.484552 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-c9e30a8b-19eb-4947-beaa-868eab5c8b48 tempest-VolumesSnapshotTestJSON-723812961 tempest-VolumesSnapshotTestJSON-723812961-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:40:18.485355 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-c9e30a8b-19eb-4947-beaa-868eab5c8b48 tempest-VolumesSnapshotTestJSON-723812961 tempest-VolumesSnapshotTestJSON-723812961-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:40:18.485786 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-c9e30a8b-19eb-4947-beaa-868eab5c8b48 tempest-VolumesSnapshotTestJSON-723812961 tempest-VolumesSnapshotTestJSON-723812961-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:40:18.493716 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG dbcounter [-] [117670] Writing DB stats nova_cell1:SELECT=53 {{(pid=117670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:40:18.507477 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.quota [None req-c9e30a8b-19eb-4947-beaa-868eab5c8b48 tempest-VolumesSnapshotTestJSON-723812961 tempest-VolumesSnapshotTestJSON-723812961-project] Getting quotas for project 3bc7c74836e6485cbb5799b77faee4fd. Resources: {'instances', 'ram', 'cores'} {{(pid=117670) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 18:40:18.512154 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.quota [None req-c9e30a8b-19eb-4947-beaa-868eab5c8b48 tempest-VolumesSnapshotTestJSON-723812961 tempest-VolumesSnapshotTestJSON-723812961-project] Getting quotas for user 006d66ec6573443bb268408501c0aaf3 and project 3bc7c74836e6485cbb5799b77faee4fd. Resources: {'instances', 'ram', 'cores'} {{(pid=117670) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 18:40:18.526424 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-c9e30a8b-19eb-4947-beaa-868eab5c8b48 tempest-VolumesSnapshotTestJSON-723812961 tempest-VolumesSnapshotTestJSON-723812961-project] Going to run 1 instances... {{(pid=117670) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 18:40:18.528772 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-c9e30a8b-19eb-4947-beaa-868eab5c8b48 tempest-VolumesSnapshotTestJSON-723812961 tempest-VolumesSnapshotTestJSON-723812961-project] [instance: ffd8a769-a724-4f30-8a46-78d0e9393645] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='38ef083a-a9ff-4836-8954-f770268ba205',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117670) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 18:40:18.594981 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-c9e30a8b-19eb-4947-beaa-868eab5c8b48 tempest-VolumesSnapshotTestJSON-723812961 tempest-VolumesSnapshotTestJSON-723812961-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.580104 Jun 16 18:40:18.595938 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 491/945] 10.222.0.30 () {60 vars in 1146 bytes} [Thu Jun 16 18:40:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 583 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 18:40:18.609371 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-8096c778-f926-4505-9ed5-74f56fc129c5 tempest-VolumesSnapshotTestJSON-723812961 tempest-VolumesSnapshotTestJSON-723812961-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:40:18.610095 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-8096c778-f926-4505-9ed5-74f56fc129c5 tempest-VolumesSnapshotTestJSON-723812961 tempest-VolumesSnapshotTestJSON-723812961-project] [instance: ffd8a769-a724-4f30-8a46-78d0e9393645] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:40:18.672379 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-8096c778-f926-4505-9ed5-74f56fc129c5 tempest-VolumesSnapshotTestJSON-723812961 tempest-VolumesSnapshotTestJSON-723812961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '006d66ec6573443bb268408501c0aaf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bc7c74836e6485cbb5799b77faee4fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:40:18.680809 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-8096c778-f926-4505-9ed5-74f56fc129c5 tempest-VolumesSnapshotTestJSON-723812961 tempest-VolumesSnapshotTestJSON-723812961-project] 10.222.0.30 "GET /compute/v2.1/servers/ffd8a769-a724-4f30-8a46-78d0e9393645" status: 200 len: 1219 microversion: 2.1 time: 0.077585 Jun 16 18:40:18.681500 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 455/946] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:40:18 2022] GET /compute/v2.1/servers/ffd8a769-a724-4f30-8a46-78d0e9393645 => generated 1219 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:40:19.707762 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-195d3c55-eec2-40ad-ba2b-948e047afcc6 tempest-VolumesSnapshotTestJSON-723812961 tempest-VolumesSnapshotTestJSON-723812961-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:40:19.708507 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-195d3c55-eec2-40ad-ba2b-948e047afcc6 tempest-VolumesSnapshotTestJSON-723812961 tempest-VolumesSnapshotTestJSON-723812961-project] [instance: ffd8a769-a724-4f30-8a46-78d0e9393645] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:40:19.771446 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-195d3c55-eec2-40ad-ba2b-948e047afcc6 tempest-VolumesSnapshotTestJSON-723812961 tempest-VolumesSnapshotTestJSON-723812961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '006d66ec6573443bb268408501c0aaf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bc7c74836e6485cbb5799b77faee4fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:40:19.778540 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-195d3c55-eec2-40ad-ba2b-948e047afcc6 tempest-VolumesSnapshotTestJSON-723812961 tempest-VolumesSnapshotTestJSON-723812961-project] 10.222.0.30 "GET /compute/v2.1/servers/ffd8a769-a724-4f30-8a46-78d0e9393645" status: 200 len: 1219 microversion: 2.1 time: 0.075395 Jun 16 18:40:19.779298 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 492/947] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:40:19 2022] GET /compute/v2.1/servers/ffd8a769-a724-4f30-8a46-78d0e9393645 => generated 1219 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:40:20.801413 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-a8ad61ad-bdee-4f85-a1f9-007bd8599c7d tempest-VolumesSnapshotTestJSON-723812961 tempest-VolumesSnapshotTestJSON-723812961-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:40:20.802612 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-a8ad61ad-bdee-4f85-a1f9-007bd8599c7d tempest-VolumesSnapshotTestJSON-723812961 tempest-VolumesSnapshotTestJSON-723812961-project] [instance: ffd8a769-a724-4f30-8a46-78d0e9393645] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:40:20.806743 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG dbcounter [-] [117671] Writing DB stats nova_api:SELECT=29 {{(pid=117671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:40:20.818011 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-a8ad61ad-bdee-4f85-a1f9-007bd8599c7d tempest-VolumesSnapshotTestJSON-723812961 tempest-VolumesSnapshotTestJSON-723812961-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:40:20.818818 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-a8ad61ad-bdee-4f85-a1f9-007bd8599c7d tempest-VolumesSnapshotTestJSON-723812961 tempest-VolumesSnapshotTestJSON-723812961-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:40:20.820260 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-a8ad61ad-bdee-4f85-a1f9-007bd8599c7d tempest-VolumesSnapshotTestJSON-723812961 tempest-VolumesSnapshotTestJSON-723812961-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:40:20.821034 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-a8ad61ad-bdee-4f85-a1f9-007bd8599c7d tempest-VolumesSnapshotTestJSON-723812961 tempest-VolumesSnapshotTestJSON-723812961-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:40:20.830325 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG dbcounter [-] [117671] Writing DB stats nova_cell1:SELECT=53 {{(pid=117671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:40:20.916510 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-a8ad61ad-bdee-4f85-a1f9-007bd8599c7d tempest-VolumesSnapshotTestJSON-723812961 tempest-VolumesSnapshotTestJSON-723812961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '006d66ec6573443bb268408501c0aaf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bc7c74836e6485cbb5799b77faee4fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:40:20.926381 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-a8ad61ad-bdee-4f85-a1f9-007bd8599c7d tempest-VolumesSnapshotTestJSON-723812961 tempest-VolumesSnapshotTestJSON-723812961-project] 10.222.0.30 "GET /compute/v2.1/servers/ffd8a769-a724-4f30-8a46-78d0e9393645" status: 200 len: 1223 microversion: 2.1 time: 0.133531 Jun 16 18:40:20.927080 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 456/948] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:40:20 2022] GET /compute/v2.1/servers/ffd8a769-a724-4f30-8a46-78d0e9393645 => generated 1223 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:40:21.944717 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-af9514d1-33b7-4ebb-974a-d6b5ec3ba08e tempest-VolumesSnapshotTestJSON-723812961 tempest-VolumesSnapshotTestJSON-723812961-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:40:21.945483 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-af9514d1-33b7-4ebb-974a-d6b5ec3ba08e tempest-VolumesSnapshotTestJSON-723812961 tempest-VolumesSnapshotTestJSON-723812961-project] [instance: ffd8a769-a724-4f30-8a46-78d0e9393645] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:40:21.953417 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-af9514d1-33b7-4ebb-974a-d6b5ec3ba08e tempest-VolumesSnapshotTestJSON-723812961 tempest-VolumesSnapshotTestJSON-723812961-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:40:21.953829 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-af9514d1-33b7-4ebb-974a-d6b5ec3ba08e tempest-VolumesSnapshotTestJSON-723812961 tempest-VolumesSnapshotTestJSON-723812961-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:40:21.954727 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-af9514d1-33b7-4ebb-974a-d6b5ec3ba08e tempest-VolumesSnapshotTestJSON-723812961 tempest-VolumesSnapshotTestJSON-723812961-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:40:21.955247 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-af9514d1-33b7-4ebb-974a-d6b5ec3ba08e tempest-VolumesSnapshotTestJSON-723812961 tempest-VolumesSnapshotTestJSON-723812961-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:40:22.064517 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-af9514d1-33b7-4ebb-974a-d6b5ec3ba08e tempest-VolumesSnapshotTestJSON-723812961 tempest-VolumesSnapshotTestJSON-723812961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '006d66ec6573443bb268408501c0aaf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bc7c74836e6485cbb5799b77faee4fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:40:22.078566 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-af9514d1-33b7-4ebb-974a-d6b5ec3ba08e tempest-VolumesSnapshotTestJSON-723812961 tempest-VolumesSnapshotTestJSON-723812961-project] 10.222.0.30 "GET /compute/v2.1/servers/ffd8a769-a724-4f30-8a46-78d0e9393645" status: 200 len: 1277 microversion: 2.1 time: 0.137551 Jun 16 18:40:22.080025 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 493/949] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:40:21 2022] GET /compute/v2.1/servers/ffd8a769-a724-4f30-8a46-78d0e9393645 => generated 1277 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:40:23.095775 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-90640008-7298-471b-b33d-252e6893e2a4 tempest-VolumesSnapshotTestJSON-723812961 tempest-VolumesSnapshotTestJSON-723812961-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:40:23.096874 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-90640008-7298-471b-b33d-252e6893e2a4 tempest-VolumesSnapshotTestJSON-723812961 tempest-VolumesSnapshotTestJSON-723812961-project] [instance: ffd8a769-a724-4f30-8a46-78d0e9393645] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:40:23.110516 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-90640008-7298-471b-b33d-252e6893e2a4 tempest-VolumesSnapshotTestJSON-723812961 tempest-VolumesSnapshotTestJSON-723812961-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:40:23.112253 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-90640008-7298-471b-b33d-252e6893e2a4 tempest-VolumesSnapshotTestJSON-723812961 tempest-VolumesSnapshotTestJSON-723812961-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:40:23.113666 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-90640008-7298-471b-b33d-252e6893e2a4 tempest-VolumesSnapshotTestJSON-723812961 tempest-VolumesSnapshotTestJSON-723812961-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:40:23.114469 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-90640008-7298-471b-b33d-252e6893e2a4 tempest-VolumesSnapshotTestJSON-723812961 tempest-VolumesSnapshotTestJSON-723812961-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:40:23.310752 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-90640008-7298-471b-b33d-252e6893e2a4 tempest-VolumesSnapshotTestJSON-723812961 tempest-VolumesSnapshotTestJSON-723812961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '006d66ec6573443bb268408501c0aaf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bc7c74836e6485cbb5799b77faee4fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:40:23.326925 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-90640008-7298-471b-b33d-252e6893e2a4 tempest-VolumesSnapshotTestJSON-723812961 tempest-VolumesSnapshotTestJSON-723812961-project] 10.222.0.30 "GET /compute/v2.1/servers/ffd8a769-a724-4f30-8a46-78d0e9393645" status: 200 len: 1319 microversion: 2.1 time: 0.233535 Jun 16 18:40:23.328149 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 457/950] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:40:23 2022] GET /compute/v2.1/servers/ffd8a769-a724-4f30-8a46-78d0e9393645 => generated 1319 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:40:23.433505 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [req-bd5f5c1c-aa22-4eca-bc1a-7fc79cf8b144 req-31b0e178-8e3c-4e6c-a951-03647d2e9281 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ffd8a769-a724-4f30-8a46-78d0e9393645", "tag": "49505317-98c6-40ac-8436-407ceeae082b"}]} {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:40:23.467264 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [req-bd5f5c1c-aa22-4eca-bc1a-7fc79cf8b144 req-31b0e178-8e3c-4e6c-a951-03647d2e9281 service nova] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:40:23.467845 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [req-bd5f5c1c-aa22-4eca-bc1a-7fc79cf8b144 req-31b0e178-8e3c-4e6c-a951-03647d2e9281 service nova] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:40:23.481543 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.compute.server_external_events [req-bd5f5c1c-aa22-4eca-bc1a-7fc79cf8b144 req-31b0e178-8e3c-4e6c-a951-03647d2e9281 service nova] Creating event network-changed:49505317-98c6-40ac-8436-407ceeae082b for instance ffd8a769-a724-4f30-8a46-78d0e9393645 on hv-cinder-81322 Jun 16 18:40:23.487794 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [req-bd5f5c1c-aa22-4eca-bc1a-7fc79cf8b144 req-31b0e178-8e3c-4e6c-a951-03647d2e9281 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060327 Jun 16 18:40:23.488820 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 494/951] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Jun 16 18:40:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:40:24.345482 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-0cfdd960-7c72-471c-a8f3-cda7d8b182e2 tempest-VolumesSnapshotTestJSON-723812961 tempest-VolumesSnapshotTestJSON-723812961-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:40:24.346153 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-0cfdd960-7c72-471c-a8f3-cda7d8b182e2 tempest-VolumesSnapshotTestJSON-723812961 tempest-VolumesSnapshotTestJSON-723812961-project] [instance: ffd8a769-a724-4f30-8a46-78d0e9393645] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:40:24.353814 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-0cfdd960-7c72-471c-a8f3-cda7d8b182e2 tempest-VolumesSnapshotTestJSON-723812961 tempest-VolumesSnapshotTestJSON-723812961-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:40:24.354278 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-0cfdd960-7c72-471c-a8f3-cda7d8b182e2 tempest-VolumesSnapshotTestJSON-723812961 tempest-VolumesSnapshotTestJSON-723812961-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:40:24.355143 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-0cfdd960-7c72-471c-a8f3-cda7d8b182e2 tempest-VolumesSnapshotTestJSON-723812961 tempest-VolumesSnapshotTestJSON-723812961-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:40:24.355584 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-0cfdd960-7c72-471c-a8f3-cda7d8b182e2 tempest-VolumesSnapshotTestJSON-723812961 tempest-VolumesSnapshotTestJSON-723812961-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:40:24.534755 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-0cfdd960-7c72-471c-a8f3-cda7d8b182e2 tempest-VolumesSnapshotTestJSON-723812961 tempest-VolumesSnapshotTestJSON-723812961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '006d66ec6573443bb268408501c0aaf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bc7c74836e6485cbb5799b77faee4fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:40:24.543052 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-0cfdd960-7c72-471c-a8f3-cda7d8b182e2 tempest-VolumesSnapshotTestJSON-723812961 tempest-VolumesSnapshotTestJSON-723812961-project] 10.222.0.30 "GET /compute/v2.1/servers/ffd8a769-a724-4f30-8a46-78d0e9393645" status: 200 len: 1319 microversion: 2.1 time: 0.202036 Jun 16 18:40:24.543680 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 458/952] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:40:24 2022] GET /compute/v2.1/servers/ffd8a769-a724-4f30-8a46-78d0e9393645 => generated 1319 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:40:25.572193 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-23691481-2ad2-4456-9971-9c3e18581101 tempest-VolumesSnapshotTestJSON-723812961 tempest-VolumesSnapshotTestJSON-723812961-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:40:25.573300 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-23691481-2ad2-4456-9971-9c3e18581101 tempest-VolumesSnapshotTestJSON-723812961 tempest-VolumesSnapshotTestJSON-723812961-project] [instance: ffd8a769-a724-4f30-8a46-78d0e9393645] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:40:25.582463 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-23691481-2ad2-4456-9971-9c3e18581101 tempest-VolumesSnapshotTestJSON-723812961 tempest-VolumesSnapshotTestJSON-723812961-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:40:25.583042 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-23691481-2ad2-4456-9971-9c3e18581101 tempest-VolumesSnapshotTestJSON-723812961 tempest-VolumesSnapshotTestJSON-723812961-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:40:25.584348 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-23691481-2ad2-4456-9971-9c3e18581101 tempest-VolumesSnapshotTestJSON-723812961 tempest-VolumesSnapshotTestJSON-723812961-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:40:25.585029 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-23691481-2ad2-4456-9971-9c3e18581101 tempest-VolumesSnapshotTestJSON-723812961 tempest-VolumesSnapshotTestJSON-723812961-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:40:25.947538 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-23691481-2ad2-4456-9971-9c3e18581101 tempest-VolumesSnapshotTestJSON-723812961 tempest-VolumesSnapshotTestJSON-723812961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '006d66ec6573443bb268408501c0aaf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bc7c74836e6485cbb5799b77faee4fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:40:25.956421 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-23691481-2ad2-4456-9971-9c3e18581101 tempest-VolumesSnapshotTestJSON-723812961 tempest-VolumesSnapshotTestJSON-723812961-project] 10.222.0.30 "GET /compute/v2.1/servers/ffd8a769-a724-4f30-8a46-78d0e9393645" status: 200 len: 1319 microversion: 2.1 time: 0.389618 Jun 16 18:40:25.957006 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 495/953] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:40:25 2022] GET /compute/v2.1/servers/ffd8a769-a724-4f30-8a46-78d0e9393645 => generated 1319 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:40:26.975380 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-05626510-0316-45b0-9e5d-a9b661b2b025 tempest-VolumesSnapshotTestJSON-723812961 tempest-VolumesSnapshotTestJSON-723812961-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:40:26.976144 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-05626510-0316-45b0-9e5d-a9b661b2b025 tempest-VolumesSnapshotTestJSON-723812961 tempest-VolumesSnapshotTestJSON-723812961-project] [instance: ffd8a769-a724-4f30-8a46-78d0e9393645] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:40:26.983680 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-05626510-0316-45b0-9e5d-a9b661b2b025 tempest-VolumesSnapshotTestJSON-723812961 tempest-VolumesSnapshotTestJSON-723812961-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:40:26.984158 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-05626510-0316-45b0-9e5d-a9b661b2b025 tempest-VolumesSnapshotTestJSON-723812961 tempest-VolumesSnapshotTestJSON-723812961-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:40:26.984938 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-05626510-0316-45b0-9e5d-a9b661b2b025 tempest-VolumesSnapshotTestJSON-723812961 tempest-VolumesSnapshotTestJSON-723812961-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:40:26.985368 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-05626510-0316-45b0-9e5d-a9b661b2b025 tempest-VolumesSnapshotTestJSON-723812961 tempest-VolumesSnapshotTestJSON-723812961-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:40:27.146287 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-05626510-0316-45b0-9e5d-a9b661b2b025 tempest-VolumesSnapshotTestJSON-723812961 tempest-VolumesSnapshotTestJSON-723812961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '006d66ec6573443bb268408501c0aaf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bc7c74836e6485cbb5799b77faee4fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:40:27.155216 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-05626510-0316-45b0-9e5d-a9b661b2b025 tempest-VolumesSnapshotTestJSON-723812961 tempest-VolumesSnapshotTestJSON-723812961-project] 10.222.0.30 "GET /compute/v2.1/servers/ffd8a769-a724-4f30-8a46-78d0e9393645" status: 200 len: 1319 microversion: 2.1 time: 0.183322 Jun 16 18:40:27.155831 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 459/954] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:40:26 2022] GET /compute/v2.1/servers/ffd8a769-a724-4f30-8a46-78d0e9393645 => generated 1319 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:40:28.173512 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-1d09dad4-e942-48f3-a69e-ea67daeb335e tempest-VolumesSnapshotTestJSON-723812961 tempest-VolumesSnapshotTestJSON-723812961-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:40:28.174085 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-1d09dad4-e942-48f3-a69e-ea67daeb335e tempest-VolumesSnapshotTestJSON-723812961 tempest-VolumesSnapshotTestJSON-723812961-project] [instance: ffd8a769-a724-4f30-8a46-78d0e9393645] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:40:28.181496 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-1d09dad4-e942-48f3-a69e-ea67daeb335e tempest-VolumesSnapshotTestJSON-723812961 tempest-VolumesSnapshotTestJSON-723812961-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:40:28.181937 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-1d09dad4-e942-48f3-a69e-ea67daeb335e tempest-VolumesSnapshotTestJSON-723812961 tempest-VolumesSnapshotTestJSON-723812961-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:40:28.182708 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-1d09dad4-e942-48f3-a69e-ea67daeb335e tempest-VolumesSnapshotTestJSON-723812961 tempest-VolumesSnapshotTestJSON-723812961-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:40:28.183136 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-1d09dad4-e942-48f3-a69e-ea67daeb335e tempest-VolumesSnapshotTestJSON-723812961 tempest-VolumesSnapshotTestJSON-723812961-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:40:28.330527 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-1d09dad4-e942-48f3-a69e-ea67daeb335e tempest-VolumesSnapshotTestJSON-723812961 tempest-VolumesSnapshotTestJSON-723812961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '006d66ec6573443bb268408501c0aaf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bc7c74836e6485cbb5799b77faee4fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:40:28.338866 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-1d09dad4-e942-48f3-a69e-ea67daeb335e tempest-VolumesSnapshotTestJSON-723812961 tempest-VolumesSnapshotTestJSON-723812961-project] 10.222.0.30 "GET /compute/v2.1/servers/ffd8a769-a724-4f30-8a46-78d0e9393645" status: 200 len: 1319 microversion: 2.1 time: 0.169580 Jun 16 18:40:28.339490 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 496/955] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:40:28 2022] GET /compute/v2.1/servers/ffd8a769-a724-4f30-8a46-78d0e9393645 => generated 1319 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:40:29.350651 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [req-be158267-77dd-4556-9261-4b2fb8e6f4a3 req-a385a0c7-abaf-4ec4-b039-af2a19670b09 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ffd8a769-a724-4f30-8a46-78d0e9393645", "name": "network-vif-plugged", "status": "completed", "tag": "49505317-98c6-40ac-8436-407ceeae082b"}]} {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:40:29.355495 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG dbcounter [-] [117671] Writing DB stats nova_cell0:SELECT=2 {{(pid=117671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:40:29.359844 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-8468b89b-cc61-4e3c-b2a7-462cc0283e66 tempest-VolumesSnapshotTestJSON-723812961 tempest-VolumesSnapshotTestJSON-723812961-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:40:29.361615 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-8468b89b-cc61-4e3c-b2a7-462cc0283e66 tempest-VolumesSnapshotTestJSON-723812961 tempest-VolumesSnapshotTestJSON-723812961-project] [instance: ffd8a769-a724-4f30-8a46-78d0e9393645] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:40:29.363195 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [req-be158267-77dd-4556-9261-4b2fb8e6f4a3 req-a385a0c7-abaf-4ec4-b039-af2a19670b09 service nova] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:40:29.363720 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [req-be158267-77dd-4556-9261-4b2fb8e6f4a3 req-a385a0c7-abaf-4ec4-b039-af2a19670b09 service nova] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:40:29.366889 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG dbcounter [-] [117670] Writing DB stats nova_cell0:SELECT=2 {{(pid=117670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:40:29.374402 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-8468b89b-cc61-4e3c-b2a7-462cc0283e66 tempest-VolumesSnapshotTestJSON-723812961 tempest-VolumesSnapshotTestJSON-723812961-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:40:29.374869 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-8468b89b-cc61-4e3c-b2a7-462cc0283e66 tempest-VolumesSnapshotTestJSON-723812961 tempest-VolumesSnapshotTestJSON-723812961-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:40:29.376582 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-8468b89b-cc61-4e3c-b2a7-462cc0283e66 tempest-VolumesSnapshotTestJSON-723812961 tempest-VolumesSnapshotTestJSON-723812961-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:40:29.377256 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-8468b89b-cc61-4e3c-b2a7-462cc0283e66 tempest-VolumesSnapshotTestJSON-723812961 tempest-VolumesSnapshotTestJSON-723812961-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:40:29.378405 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.compute.server_external_events [req-be158267-77dd-4556-9261-4b2fb8e6f4a3 req-a385a0c7-abaf-4ec4-b039-af2a19670b09 service nova] Creating event network-vif-plugged:49505317-98c6-40ac-8436-407ceeae082b for instance ffd8a769-a724-4f30-8a46-78d0e9393645 on hv-cinder-81322 Jun 16 18:40:29.384150 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [req-be158267-77dd-4556-9261-4b2fb8e6f4a3 req-a385a0c7-abaf-4ec4-b039-af2a19670b09 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036878 Jun 16 18:40:29.385741 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 460/956] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Jun 16 18:40:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 18:40:29.598584 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-8468b89b-cc61-4e3c-b2a7-462cc0283e66 tempest-VolumesSnapshotTestJSON-723812961 tempest-VolumesSnapshotTestJSON-723812961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '006d66ec6573443bb268408501c0aaf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bc7c74836e6485cbb5799b77faee4fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:40:29.607395 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-8468b89b-cc61-4e3c-b2a7-462cc0283e66 tempest-VolumesSnapshotTestJSON-723812961 tempest-VolumesSnapshotTestJSON-723812961-project] 10.222.0.30 "GET /compute/v2.1/servers/ffd8a769-a724-4f30-8a46-78d0e9393645" status: 200 len: 1319 microversion: 2.1 time: 0.253278 Jun 16 18:40:29.608042 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 497/957] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:40:29 2022] GET /compute/v2.1/servers/ffd8a769-a724-4f30-8a46-78d0e9393645 => generated 1319 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:40:30.632104 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-a4e1a2cd-5c70-432f-adb4-6be10092177b tempest-VolumesSnapshotTestJSON-723812961 tempest-VolumesSnapshotTestJSON-723812961-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:40:30.633456 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-a4e1a2cd-5c70-432f-adb4-6be10092177b tempest-VolumesSnapshotTestJSON-723812961 tempest-VolumesSnapshotTestJSON-723812961-project] [instance: ffd8a769-a724-4f30-8a46-78d0e9393645] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:40:30.645493 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-a4e1a2cd-5c70-432f-adb4-6be10092177b tempest-VolumesSnapshotTestJSON-723812961 tempest-VolumesSnapshotTestJSON-723812961-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:40:30.646201 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-a4e1a2cd-5c70-432f-adb4-6be10092177b tempest-VolumesSnapshotTestJSON-723812961 tempest-VolumesSnapshotTestJSON-723812961-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:40:30.648643 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-a4e1a2cd-5c70-432f-adb4-6be10092177b tempest-VolumesSnapshotTestJSON-723812961 tempest-VolumesSnapshotTestJSON-723812961-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:40:30.649743 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-a4e1a2cd-5c70-432f-adb4-6be10092177b tempest-VolumesSnapshotTestJSON-723812961 tempest-VolumesSnapshotTestJSON-723812961-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:40:30.834849 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-a4e1a2cd-5c70-432f-adb4-6be10092177b tempest-VolumesSnapshotTestJSON-723812961 tempest-VolumesSnapshotTestJSON-723812961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '006d66ec6573443bb268408501c0aaf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bc7c74836e6485cbb5799b77faee4fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:40:30.847028 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-a4e1a2cd-5c70-432f-adb4-6be10092177b tempest-VolumesSnapshotTestJSON-723812961 tempest-VolumesSnapshotTestJSON-723812961-project] 10.222.0.30 "GET /compute/v2.1/servers/ffd8a769-a724-4f30-8a46-78d0e9393645" status: 200 len: 1319 microversion: 2.1 time: 0.224198 Jun 16 18:40:30.848504 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 461/958] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:40:30 2022] GET /compute/v2.1/servers/ffd8a769-a724-4f30-8a46-78d0e9393645 => generated 1319 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:40:31.040087 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 16 18:40:31.040363 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: Thu Jun 16 18:40:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 16 18:40:31.867050 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-3aa414f2-1e04-4821-8b4f-374b91d69e12 tempest-VolumesSnapshotTestJSON-723812961 tempest-VolumesSnapshotTestJSON-723812961-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:40:31.867901 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-3aa414f2-1e04-4821-8b4f-374b91d69e12 tempest-VolumesSnapshotTestJSON-723812961 tempest-VolumesSnapshotTestJSON-723812961-project] [instance: ffd8a769-a724-4f30-8a46-78d0e9393645] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:40:31.869767 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG dbcounter [-] [117670] Writing DB stats nova_cell0:SELECT=8 {{(pid=117670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:40:31.877414 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-3aa414f2-1e04-4821-8b4f-374b91d69e12 tempest-VolumesSnapshotTestJSON-723812961 tempest-VolumesSnapshotTestJSON-723812961-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:40:31.877842 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-3aa414f2-1e04-4821-8b4f-374b91d69e12 tempest-VolumesSnapshotTestJSON-723812961 tempest-VolumesSnapshotTestJSON-723812961-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:40:31.878597 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-3aa414f2-1e04-4821-8b4f-374b91d69e12 tempest-VolumesSnapshotTestJSON-723812961 tempest-VolumesSnapshotTestJSON-723812961-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:40:31.879209 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-3aa414f2-1e04-4821-8b4f-374b91d69e12 tempest-VolumesSnapshotTestJSON-723812961 tempest-VolumesSnapshotTestJSON-723812961-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:40:32.033067 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-3aa414f2-1e04-4821-8b4f-374b91d69e12 tempest-VolumesSnapshotTestJSON-723812961 tempest-VolumesSnapshotTestJSON-723812961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '006d66ec6573443bb268408501c0aaf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bc7c74836e6485cbb5799b77faee4fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:40:32.040755 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-3aa414f2-1e04-4821-8b4f-374b91d69e12 tempest-VolumesSnapshotTestJSON-723812961 tempest-VolumesSnapshotTestJSON-723812961-project] 10.222.0.30 "GET /compute/v2.1/servers/ffd8a769-a724-4f30-8a46-78d0e9393645" status: 200 len: 1507 microversion: 2.1 time: 0.178070 Jun 16 18:40:32.041336 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 498/959] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:40:31 2022] GET /compute/v2.1/servers/ffd8a769-a724-4f30-8a46-78d0e9393645 => generated 1507 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:40:47.419272 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-0258e15a-014d-47b0-a58a-9e566584d0ee tempest-VolumesSnapshotTestJSON-723812961 tempest-VolumesSnapshotTestJSON-723812961-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "dfbb3669-7738-45a4-8319-684be1960b9b", "device": "/dev/sdb"}} {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:40:47.422384 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-0258e15a-014d-47b0-a58a-9e566584d0ee tempest-VolumesSnapshotTestJSON-723812961 tempest-VolumesSnapshotTestJSON-723812961-project] [instance: ffd8a769-a724-4f30-8a46-78d0e9393645] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:40:47.425974 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG dbcounter [-] [117671] Writing DB stats nova_api:SELECT=11 {{(pid=117671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:40:47.427021 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG dbcounter [-] [117671] Writing DB stats nova_cell1:SELECT=31 {{(pid=117671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:40:47.439240 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-0258e15a-014d-47b0-a58a-9e566584d0ee tempest-VolumesSnapshotTestJSON-723812961 tempest-VolumesSnapshotTestJSON-723812961-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:40:47.439903 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-0258e15a-014d-47b0-a58a-9e566584d0ee tempest-VolumesSnapshotTestJSON-723812961 tempest-VolumesSnapshotTestJSON-723812961-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:40:47.441156 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-0258e15a-014d-47b0-a58a-9e566584d0ee tempest-VolumesSnapshotTestJSON-723812961 tempest-VolumesSnapshotTestJSON-723812961-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:40:47.441801 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-0258e15a-014d-47b0-a58a-9e566584d0ee tempest-VolumesSnapshotTestJSON-723812961 tempest-VolumesSnapshotTestJSON-723812961-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:40:47.782236 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-0258e15a-014d-47b0-a58a-9e566584d0ee tempest-VolumesSnapshotTestJSON-723812961 tempest-VolumesSnapshotTestJSON-723812961-project] 10.222.0.30 "POST /compute/v2.1/servers/ffd8a769-a724-4f30-8a46-78d0e9393645/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.370088 Jun 16 18:40:47.782957 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 462/960] 10.222.0.30 () {60 vars in 1322 bytes} [Thu Jun 16 18:40:47 2022] POST /compute/v2.1/servers/ffd8a769-a724-4f30-8a46-78d0e9393645/os-volume_attachments => generated 194 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:41:07.763755 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-f6fa57df-7613-4593-b96c-9009de2da7ad tempest-VolumesSnapshotTestJSON-723812961 tempest-VolumesSnapshotTestJSON-723812961-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:41:07.764671 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-f6fa57df-7613-4593-b96c-9009de2da7ad tempest-VolumesSnapshotTestJSON-723812961 tempest-VolumesSnapshotTestJSON-723812961-project] [instance: ffd8a769-a724-4f30-8a46-78d0e9393645] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:41:07.767764 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG dbcounter [-] [117670] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=3 {{(pid=117670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:41:07.769198 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG dbcounter [-] [117670] Writing DB stats nova_cell1:SELECT=33 {{(pid=117670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:41:07.779363 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-f6fa57df-7613-4593-b96c-9009de2da7ad tempest-VolumesSnapshotTestJSON-723812961 tempest-VolumesSnapshotTestJSON-723812961-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:41:07.779818 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-f6fa57df-7613-4593-b96c-9009de2da7ad tempest-VolumesSnapshotTestJSON-723812961 tempest-VolumesSnapshotTestJSON-723812961-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:41:07.780681 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-f6fa57df-7613-4593-b96c-9009de2da7ad tempest-VolumesSnapshotTestJSON-723812961 tempest-VolumesSnapshotTestJSON-723812961-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:41:07.781154 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-f6fa57df-7613-4593-b96c-9009de2da7ad tempest-VolumesSnapshotTestJSON-723812961 tempest-VolumesSnapshotTestJSON-723812961-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:41:07.904929 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.objects.instance [None req-f6fa57df-7613-4593-b96c-9009de2da7ad tempest-VolumesSnapshotTestJSON-723812961 tempest-VolumesSnapshotTestJSON-723812961-project] Lazy-loading 'services' on Instance uuid ffd8a769-a724-4f30-8a46-78d0e9393645 {{(pid=117670) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 18:41:08.011681 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-f6fa57df-7613-4593-b96c-9009de2da7ad tempest-VolumesSnapshotTestJSON-723812961 tempest-VolumesSnapshotTestJSON-723812961-project] 10.222.0.30 "DELETE /compute/v2.1/servers/ffd8a769-a724-4f30-8a46-78d0e9393645/os-volume_attachments/dfbb3669-7738-45a4-8319-684be1960b9b" status: 202 len: 0 microversion: 2.1 time: 0.253061 Jun 16 18:41:08.012498 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 499/961] 10.222.0.30 () {58 vars in 1415 bytes} [Thu Jun 16 18:41:07 2022] DELETE /compute/v2.1/servers/ffd8a769-a724-4f30-8a46-78d0e9393645/os-volume_attachments/dfbb3669-7738-45a4-8319-684be1960b9b => generated 0 bytes in 255 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 18:41:09.172928 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG dbcounter [-] [117671] Writing DB stats nova_api:SELECT=2 {{(pid=117671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:41:09.174237 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG dbcounter [-] [117671] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:41:09.179828 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-5de3d72a-a61f-42a8-a7c4-9fd6a86865f2 tempest-VolumesSnapshotTestJSON-723812961 tempest-VolumesSnapshotTestJSON-723812961-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:41:09.180475 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-5de3d72a-a61f-42a8-a7c4-9fd6a86865f2 tempest-VolumesSnapshotTestJSON-723812961 tempest-VolumesSnapshotTestJSON-723812961-project] [instance: ffd8a769-a724-4f30-8a46-78d0e9393645] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:41:09.189185 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-5de3d72a-a61f-42a8-a7c4-9fd6a86865f2 tempest-VolumesSnapshotTestJSON-723812961 tempest-VolumesSnapshotTestJSON-723812961-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:41:09.189798 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-5de3d72a-a61f-42a8-a7c4-9fd6a86865f2 tempest-VolumesSnapshotTestJSON-723812961 tempest-VolumesSnapshotTestJSON-723812961-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:41:09.190711 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-5de3d72a-a61f-42a8-a7c4-9fd6a86865f2 tempest-VolumesSnapshotTestJSON-723812961 tempest-VolumesSnapshotTestJSON-723812961-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:41:09.191565 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-5de3d72a-a61f-42a8-a7c4-9fd6a86865f2 tempest-VolumesSnapshotTestJSON-723812961 tempest-VolumesSnapshotTestJSON-723812961-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:41:09.223820 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-5de3d72a-a61f-42a8-a7c4-9fd6a86865f2 tempest-VolumesSnapshotTestJSON-723812961 tempest-VolumesSnapshotTestJSON-723812961-project] [instance: ffd8a769-a724-4f30-8a46-78d0e9393645] Going to try to terminate instance {{(pid=117671) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 18:41:09.321861 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-5de3d72a-a61f-42a8-a7c4-9fd6a86865f2 tempest-VolumesSnapshotTestJSON-723812961 tempest-VolumesSnapshotTestJSON-723812961-project] 10.222.0.30 "DELETE /compute/v2.1/servers/ffd8a769-a724-4f30-8a46-78d0e9393645" status: 204 len: 0 microversion: 2.1 time: 0.150247 Jun 16 18:41:09.323214 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 463/962] 10.222.0.30 () {58 vars in 1238 bytes} [Thu Jun 16 18:41:09 2022] DELETE /compute/v2.1/servers/ffd8a769-a724-4f30-8a46-78d0e9393645 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 18:41:09.334586 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-db3a4c50-6191-44fe-acaa-f9c0062080a4 tempest-VolumesSnapshotTestJSON-723812961 tempest-VolumesSnapshotTestJSON-723812961-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:41:09.335288 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-db3a4c50-6191-44fe-acaa-f9c0062080a4 tempest-VolumesSnapshotTestJSON-723812961 tempest-VolumesSnapshotTestJSON-723812961-project] [instance: ffd8a769-a724-4f30-8a46-78d0e9393645] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:41:09.342943 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-db3a4c50-6191-44fe-acaa-f9c0062080a4 tempest-VolumesSnapshotTestJSON-723812961 tempest-VolumesSnapshotTestJSON-723812961-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:41:09.343383 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-db3a4c50-6191-44fe-acaa-f9c0062080a4 tempest-VolumesSnapshotTestJSON-723812961 tempest-VolumesSnapshotTestJSON-723812961-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:41:09.344212 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-db3a4c50-6191-44fe-acaa-f9c0062080a4 tempest-VolumesSnapshotTestJSON-723812961 tempest-VolumesSnapshotTestJSON-723812961-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:41:09.344650 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-db3a4c50-6191-44fe-acaa-f9c0062080a4 tempest-VolumesSnapshotTestJSON-723812961 tempest-VolumesSnapshotTestJSON-723812961-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:41:09.516710 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-db3a4c50-6191-44fe-acaa-f9c0062080a4 tempest-VolumesSnapshotTestJSON-723812961 tempest-VolumesSnapshotTestJSON-723812961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '006d66ec6573443bb268408501c0aaf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bc7c74836e6485cbb5799b77faee4fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:41:09.526062 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-db3a4c50-6191-44fe-acaa-f9c0062080a4 tempest-VolumesSnapshotTestJSON-723812961 tempest-VolumesSnapshotTestJSON-723812961-project] 10.222.0.30 "GET /compute/v2.1/servers/ffd8a769-a724-4f30-8a46-78d0e9393645" status: 200 len: 1513 microversion: 2.1 time: 0.196431 Jun 16 18:41:09.526658 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 500/963] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:41:09 2022] GET /compute/v2.1/servers/ffd8a769-a724-4f30-8a46-78d0e9393645 => generated 1513 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:41:10.548228 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-f1c29634-919d-4910-aa52-8195b3b389ce tempest-VolumesSnapshotTestJSON-723812961 tempest-VolumesSnapshotTestJSON-723812961-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:41:10.549762 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-f1c29634-919d-4910-aa52-8195b3b389ce tempest-VolumesSnapshotTestJSON-723812961 tempest-VolumesSnapshotTestJSON-723812961-project] [instance: ffd8a769-a724-4f30-8a46-78d0e9393645] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:41:10.557481 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-f1c29634-919d-4910-aa52-8195b3b389ce tempest-VolumesSnapshotTestJSON-723812961 tempest-VolumesSnapshotTestJSON-723812961-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:41:10.557920 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-f1c29634-919d-4910-aa52-8195b3b389ce tempest-VolumesSnapshotTestJSON-723812961 tempest-VolumesSnapshotTestJSON-723812961-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:41:10.559446 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-f1c29634-919d-4910-aa52-8195b3b389ce tempest-VolumesSnapshotTestJSON-723812961 tempest-VolumesSnapshotTestJSON-723812961-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:41:10.559928 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-f1c29634-919d-4910-aa52-8195b3b389ce tempest-VolumesSnapshotTestJSON-723812961 tempest-VolumesSnapshotTestJSON-723812961-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:41:10.721247 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-f1c29634-919d-4910-aa52-8195b3b389ce tempest-VolumesSnapshotTestJSON-723812961 tempest-VolumesSnapshotTestJSON-723812961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '006d66ec6573443bb268408501c0aaf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bc7c74836e6485cbb5799b77faee4fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:41:10.736010 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-f1c29634-919d-4910-aa52-8195b3b389ce tempest-VolumesSnapshotTestJSON-723812961 tempest-VolumesSnapshotTestJSON-723812961-project] 10.222.0.30 "GET /compute/v2.1/servers/ffd8a769-a724-4f30-8a46-78d0e9393645" status: 200 len: 1513 microversion: 2.1 time: 0.193739 Jun 16 18:41:10.737194 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 464/964] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:41:10 2022] GET /compute/v2.1/servers/ffd8a769-a724-4f30-8a46-78d0e9393645 => generated 1513 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:41:11.521517 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [req-04a91e45-d793-421e-8caf-7fd7c26ae22d req-543492e3-ef63-471a-a876-7c08375e01bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ffd8a769-a724-4f30-8a46-78d0e9393645", "name": "network-vif-deleted", "tag": "49505317-98c6-40ac-8436-407ceeae082b"}]} {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:41:11.545986 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [req-04a91e45-d793-421e-8caf-7fd7c26ae22d req-543492e3-ef63-471a-a876-7c08375e01bc service nova] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:41:11.546779 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [req-04a91e45-d793-421e-8caf-7fd7c26ae22d req-543492e3-ef63-471a-a876-7c08375e01bc service nova] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:41:11.573874 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.compute.server_external_events [req-04a91e45-d793-421e-8caf-7fd7c26ae22d req-543492e3-ef63-471a-a876-7c08375e01bc service nova] Creating event network-vif-deleted:49505317-98c6-40ac-8436-407ceeae082b for instance ffd8a769-a724-4f30-8a46-78d0e9393645 on hv-cinder-81322 Jun 16 18:41:11.584125 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [req-04a91e45-d793-421e-8caf-7fd7c26ae22d req-543492e3-ef63-471a-a876-7c08375e01bc service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069731 Jun 16 18:41:11.584752 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 501/965] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Jun 16 18:41:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:41:11.763820 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-07905e9f-70f2-4a51-ac9e-b044cf2cb0bb tempest-VolumesSnapshotTestJSON-723812961 tempest-VolumesSnapshotTestJSON-723812961-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:41:11.764524 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-07905e9f-70f2-4a51-ac9e-b044cf2cb0bb tempest-VolumesSnapshotTestJSON-723812961 tempest-VolumesSnapshotTestJSON-723812961-project] [instance: ffd8a769-a724-4f30-8a46-78d0e9393645] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:41:11.771348 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-07905e9f-70f2-4a51-ac9e-b044cf2cb0bb tempest-VolumesSnapshotTestJSON-723812961 tempest-VolumesSnapshotTestJSON-723812961-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:41:11.771794 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-07905e9f-70f2-4a51-ac9e-b044cf2cb0bb tempest-VolumesSnapshotTestJSON-723812961 tempest-VolumesSnapshotTestJSON-723812961-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:41:11.772613 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-07905e9f-70f2-4a51-ac9e-b044cf2cb0bb tempest-VolumesSnapshotTestJSON-723812961 tempest-VolumesSnapshotTestJSON-723812961-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:41:11.773047 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-07905e9f-70f2-4a51-ac9e-b044cf2cb0bb tempest-VolumesSnapshotTestJSON-723812961 tempest-VolumesSnapshotTestJSON-723812961-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:41:11.811997 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-07905e9f-70f2-4a51-ac9e-b044cf2cb0bb tempest-VolumesSnapshotTestJSON-723812961 tempest-VolumesSnapshotTestJSON-723812961-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:41:11.812486 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-07905e9f-70f2-4a51-ac9e-b044cf2cb0bb tempest-VolumesSnapshotTestJSON-723812961 tempest-VolumesSnapshotTestJSON-723812961-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:41:11.812948 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.objects.instance [None req-07905e9f-70f2-4a51-ac9e-b044cf2cb0bb tempest-VolumesSnapshotTestJSON-723812961 tempest-VolumesSnapshotTestJSON-723812961-project] Lazy-loading 'fault' on Instance uuid ffd8a769-a724-4f30-8a46-78d0e9393645 {{(pid=117671) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 18:41:11.859046 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-07905e9f-70f2-4a51-ac9e-b044cf2cb0bb tempest-VolumesSnapshotTestJSON-723812961 tempest-VolumesSnapshotTestJSON-723812961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '006d66ec6573443bb268408501c0aaf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bc7c74836e6485cbb5799b77faee4fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:41:11.867458 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-07905e9f-70f2-4a51-ac9e-b044cf2cb0bb tempest-VolumesSnapshotTestJSON-723812961 tempest-VolumesSnapshotTestJSON-723812961-project] 10.222.0.30 "GET /compute/v2.1/servers/ffd8a769-a724-4f30-8a46-78d0e9393645" status: 200 len: 1309 microversion: 2.1 time: 0.108161 Jun 16 18:41:11.868083 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 465/966] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:41:11 2022] GET /compute/v2.1/servers/ffd8a769-a724-4f30-8a46-78d0e9393645 => generated 1309 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:41:12.886266 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-c9899b33-f1fe-47e6-a84a-00f7afa8e587 tempest-VolumesSnapshotTestJSON-723812961 tempest-VolumesSnapshotTestJSON-723812961-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:41:12.887216 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-c9899b33-f1fe-47e6-a84a-00f7afa8e587 tempest-VolumesSnapshotTestJSON-723812961 tempest-VolumesSnapshotTestJSON-723812961-project] [instance: ffd8a769-a724-4f30-8a46-78d0e9393645] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:41:12.894892 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-c9899b33-f1fe-47e6-a84a-00f7afa8e587 tempest-VolumesSnapshotTestJSON-723812961 tempest-VolumesSnapshotTestJSON-723812961-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:41:12.895381 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-c9899b33-f1fe-47e6-a84a-00f7afa8e587 tempest-VolumesSnapshotTestJSON-723812961 tempest-VolumesSnapshotTestJSON-723812961-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:41:12.896214 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-c9899b33-f1fe-47e6-a84a-00f7afa8e587 tempest-VolumesSnapshotTestJSON-723812961 tempest-VolumesSnapshotTestJSON-723812961-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:41:12.896657 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-c9899b33-f1fe-47e6-a84a-00f7afa8e587 tempest-VolumesSnapshotTestJSON-723812961 tempest-VolumesSnapshotTestJSON-723812961-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:41:12.912633 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.wsgi [None req-c9899b33-f1fe-47e6-a84a-00f7afa8e587 tempest-VolumesSnapshotTestJSON-723812961 tempest-VolumesSnapshotTestJSON-723812961-project] HTTP exception thrown: Instance ffd8a769-a724-4f30-8a46-78d0e9393645 could not be found. Jun 16 18:41:12.914741 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-c9899b33-f1fe-47e6-a84a-00f7afa8e587 tempest-VolumesSnapshotTestJSON-723812961 tempest-VolumesSnapshotTestJSON-723812961-project] Request method failure captured: Jun 16 18:41:12.914741 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: request: GET /compute/v2.1/servers/ffd8a769-a724-4f30-8a46-78d0e9393645 HTTP/1.1 Jun 16 18:41:12.914741 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: Accept: application/json Jun 16 18:41:12.914741 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: Accept-Encoding: identity Jun 16 18:41:12.914741 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: Connection: close Jun 16 18:41:12.914741 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: Content-Length: 0 Jun 16 18:41:12.914741 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: Content-Type: application/json Jun 16 18:41:12.914741 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: Host: 10.222.0.30 Jun 16 18:41:12.914741 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: Openstack-System-Scope: None Jun 16 18:41:12.914741 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: User-Agent: python-urllib3/1.26.9 Jun 16 18:41:12.914741 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Auth-Token: gAAAAABiq3kQdW6OEEk-N_f3iVrgZ5DB5eDkeYO-gjnu70pO_CbEms21M3EL_0b6ZjwT9HgmeDRh_HeTe5S8DHkNzrYN9z_NXnbakIhFgWhunjlhjMzOtAKV1VoWODFo59lJo5bZy9rjUiEAI59X2Wli4BEUEExUV9esmgId1pKY53ZJVxvFMB8 Jun 16 18:41:12.914741 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Domain-Id: None Jun 16 18:41:12.914741 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Domain-Name: None Jun 16 18:41:12.914741 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Identity-Status: Confirmed Jun 16 18:41:12.914741 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Is-Admin-Project: True Jun 16 18:41:12.914741 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Project-Domain-Id: default Jun 16 18:41:12.914741 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Project-Domain-Name: Default Jun 16 18:41:12.914741 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Project-Id: 3bc7c74836e6485cbb5799b77faee4fd Jun 16 18:41:12.914741 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Project-Name: tempest-VolumesSnapshotTestJSON-723812961 Jun 16 18:41:12.914741 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Role: reader,member Jun 16 18:41:12.914741 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Roles: reader,member Jun 16 18:41:12.916668 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/3bc7c74836e6485cbb5799b77faee4fd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/3bc7c74836e6485cbb5799b77faee4fd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_3bc7c74836e6485cbb5799b77faee4fd", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/3bc7c74836e6485cbb5799b77faee4fd"}]}] Jun 16 18:41:12.916668 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Tenant: tempest-VolumesSnapshotTestJSON-723812961 Jun 16 18:41:12.916668 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Tenant-Id: 3bc7c74836e6485cbb5799b77faee4fd Jun 16 18:41:12.916668 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-723812961 Jun 16 18:41:12.916668 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-User: tempest-VolumesSnapshotTestJSON-723812961-project Jun 16 18:41:12.916668 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-User-Domain-Id: default Jun 16 18:41:12.916668 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-User-Domain-Name: Default Jun 16 18:41:12.916668 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-User-Id: 006d66ec6573443bb268408501c0aaf3 Jun 16 18:41:12.916668 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-User-Name: tempest-VolumesSnapshotTestJSON-723812961-project Jun 16 18:41:12.916668 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: method: > Jun 16 18:41:12.916668 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: exception: Instance ffd8a769-a724-4f30-8a46-78d0e9393645 could not be found. Jun 16 18:41:12.916668 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: action_args: {'id': 'ffd8a769-a724-4f30-8a46-78d0e9393645'} Jun 16 18:41:12.917870 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:41:12.917870 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:41:12.917870 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 18:41:12.917870 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 18:41:12.917870 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 18:41:12.917870 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 18:41:12.917870 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 18:41:12.917870 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 18:41:12.917870 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 18:41:12.917870 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 18:41:12.917870 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ffd8a769-a724-4f30-8a46-78d0e9393645 could not be found. Jun 16 18:41:12.917870 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi Jun 16 18:41:12.917870 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:41:12.917870 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi Jun 16 18:41:12.917870 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:41:12.917870 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:41:12.917870 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:41:12.917870 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:41:12.917870 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:41:12.917870 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:41:12.921215 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:41:12.921215 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 18:41:12.921215 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 18:41:12.921215 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 18:41:12.921215 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 18:41:12.921215 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 18:41:12.921215 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:41:12.921215 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ffd8a769-a724-4f30-8a46-78d0e9393645 could not be found. Jun 16 18:41:12.921215 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi Jun 16 18:41:12.921215 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:41:12.921215 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi Jun 16 18:41:12.921215 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:41:12.921215 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:41:12.921215 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:41:12.921215 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:41:12.921215 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:41:12.921215 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ffd8a769-a724-4f30-8a46-78d0e9393645 could not be found. Jun 16 18:41:12.921215 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi Jun 16 18:41:12.923176 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-c9899b33-f1fe-47e6-a84a-00f7afa8e587 tempest-VolumesSnapshotTestJSON-723812961 tempest-VolumesSnapshotTestJSON-723812961-project] Returning 404 to user: Instance ffd8a769-a724-4f30-8a46-78d0e9393645 could not be found. {{(pid=117670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:41:12.923176 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-c9899b33-f1fe-47e6-a84a-00f7afa8e587 tempest-VolumesSnapshotTestJSON-723812961 tempest-VolumesSnapshotTestJSON-723812961-project] 10.222.0.30 "GET /compute/v2.1/servers/ffd8a769-a724-4f30-8a46-78d0e9393645" status: 404 len: 111 microversion: 2.1 time: 0.034830 Jun 16 18:41:12.923176 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 502/967] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:41:12 2022] GET /compute/v2.1/servers/ffd8a769-a724-4f30-8a46-78d0e9393645 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 16 18:41:20.917641 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-48ba719e-80dc-4616-a222-0a52d849c597 tempest-VolumesSnapshotTestJSON-723812961 tempest-VolumesSnapshotTestJSON-723812961-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1899986774", "imageRef": "38ef083a-a9ff-4836-8954-f770268ba205", "flavorRef": "452", "networks": [{"uuid": "f9ae11bf-ea91-454f-9c1b-43afd598e56c"}]}} {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:41:20.980081 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.network.neutron [None req-48ba719e-80dc-4616-a222-0a52d849c597 tempest-VolumesSnapshotTestJSON-723812961 tempest-VolumesSnapshotTestJSON-723812961-project] validate_networks() for [('f9ae11bf-ea91-454f-9c1b-43afd598e56c', None, None, None, None, None)] {{(pid=117671) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 18:41:21.442734 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.virt.hardware [None req-48ba719e-80dc-4616-a222-0a52d849c597 tempest-VolumesSnapshotTestJSON-723812961 tempest-VolumesSnapshotTestJSON-723812961-project] Flavor limits 0:0:0 {{(pid=117671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 18:41:21.443480 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.virt.hardware [None req-48ba719e-80dc-4616-a222-0a52d849c597 tempest-VolumesSnapshotTestJSON-723812961 tempest-VolumesSnapshotTestJSON-723812961-project] Image limits 0:0:0 {{(pid=117671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 18:41:21.444391 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.virt.hardware [None req-48ba719e-80dc-4616-a222-0a52d849c597 tempest-VolumesSnapshotTestJSON-723812961 tempest-VolumesSnapshotTestJSON-723812961-project] Flavor pref 0:0:0 {{(pid=117671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 18:41:21.445145 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.virt.hardware [None req-48ba719e-80dc-4616-a222-0a52d849c597 tempest-VolumesSnapshotTestJSON-723812961 tempest-VolumesSnapshotTestJSON-723812961-project] Image pref 0:0:0 {{(pid=117671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 18:41:21.445916 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.virt.hardware [None req-48ba719e-80dc-4616-a222-0a52d849c597 tempest-VolumesSnapshotTestJSON-723812961 tempest-VolumesSnapshotTestJSON-723812961-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117671) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 18:41:21.462822 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-48ba719e-80dc-4616-a222-0a52d849c597 tempest-VolumesSnapshotTestJSON-723812961 tempest-VolumesSnapshotTestJSON-723812961-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:41:21.463605 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-48ba719e-80dc-4616-a222-0a52d849c597 tempest-VolumesSnapshotTestJSON-723812961 tempest-VolumesSnapshotTestJSON-723812961-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:41:21.465050 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-48ba719e-80dc-4616-a222-0a52d849c597 tempest-VolumesSnapshotTestJSON-723812961 tempest-VolumesSnapshotTestJSON-723812961-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:41:21.465849 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-48ba719e-80dc-4616-a222-0a52d849c597 tempest-VolumesSnapshotTestJSON-723812961 tempest-VolumesSnapshotTestJSON-723812961-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:41:21.495726 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.quota [None req-48ba719e-80dc-4616-a222-0a52d849c597 tempest-VolumesSnapshotTestJSON-723812961 tempest-VolumesSnapshotTestJSON-723812961-project] Getting quotas for project 3bc7c74836e6485cbb5799b77faee4fd. Resources: {'instances', 'ram', 'cores'} {{(pid=117671) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 18:41:21.501085 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.quota [None req-48ba719e-80dc-4616-a222-0a52d849c597 tempest-VolumesSnapshotTestJSON-723812961 tempest-VolumesSnapshotTestJSON-723812961-project] Getting quotas for user 006d66ec6573443bb268408501c0aaf3 and project 3bc7c74836e6485cbb5799b77faee4fd. Resources: {'instances', 'ram', 'cores'} {{(pid=117671) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 18:41:21.515640 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-48ba719e-80dc-4616-a222-0a52d849c597 tempest-VolumesSnapshotTestJSON-723812961 tempest-VolumesSnapshotTestJSON-723812961-project] Going to run 1 instances... {{(pid=117671) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 18:41:21.518116 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-48ba719e-80dc-4616-a222-0a52d849c597 tempest-VolumesSnapshotTestJSON-723812961 tempest-VolumesSnapshotTestJSON-723812961-project] [instance: bc8e84f5-f7b3-4ad0-bccf-07f602eb239e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='38ef083a-a9ff-4836-8954-f770268ba205',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117671) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 18:41:21.569988 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-48ba719e-80dc-4616-a222-0a52d849c597 tempest-VolumesSnapshotTestJSON-723812961 tempest-VolumesSnapshotTestJSON-723812961-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.656116 Jun 16 18:41:21.570921 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 466/968] 10.222.0.30 () {60 vars in 1146 bytes} [Thu Jun 16 18:41:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 658 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 18:41:21.583413 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-579f1c88-21e5-40b1-9118-a40a6a640b15 tempest-VolumesSnapshotTestJSON-723812961 tempest-VolumesSnapshotTestJSON-723812961-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:41:21.584359 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-579f1c88-21e5-40b1-9118-a40a6a640b15 tempest-VolumesSnapshotTestJSON-723812961 tempest-VolumesSnapshotTestJSON-723812961-project] [instance: bc8e84f5-f7b3-4ad0-bccf-07f602eb239e] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:41:21.655560 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-579f1c88-21e5-40b1-9118-a40a6a640b15 tempest-VolumesSnapshotTestJSON-723812961 tempest-VolumesSnapshotTestJSON-723812961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '006d66ec6573443bb268408501c0aaf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bc7c74836e6485cbb5799b77faee4fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:41:21.662709 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-579f1c88-21e5-40b1-9118-a40a6a640b15 tempest-VolumesSnapshotTestJSON-723812961 tempest-VolumesSnapshotTestJSON-723812961-project] 10.222.0.30 "GET /compute/v2.1/servers/bc8e84f5-f7b3-4ad0-bccf-07f602eb239e" status: 200 len: 1219 microversion: 2.1 time: 0.083747 Jun 16 18:41:21.663296 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 503/969] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:41:21 2022] GET /compute/v2.1/servers/bc8e84f5-f7b3-4ad0-bccf-07f602eb239e => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:41:22.686696 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-fb2ce09f-2ac5-4e4b-892f-049b6cf195e4 tempest-VolumesSnapshotTestJSON-723812961 tempest-VolumesSnapshotTestJSON-723812961-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:41:22.687804 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-fb2ce09f-2ac5-4e4b-892f-049b6cf195e4 tempest-VolumesSnapshotTestJSON-723812961 tempest-VolumesSnapshotTestJSON-723812961-project] [instance: bc8e84f5-f7b3-4ad0-bccf-07f602eb239e] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:41:22.701009 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-fb2ce09f-2ac5-4e4b-892f-049b6cf195e4 tempest-VolumesSnapshotTestJSON-723812961 tempest-VolumesSnapshotTestJSON-723812961-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:41:22.701809 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-fb2ce09f-2ac5-4e4b-892f-049b6cf195e4 tempest-VolumesSnapshotTestJSON-723812961 tempest-VolumesSnapshotTestJSON-723812961-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:41:22.703210 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-fb2ce09f-2ac5-4e4b-892f-049b6cf195e4 tempest-VolumesSnapshotTestJSON-723812961 tempest-VolumesSnapshotTestJSON-723812961-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:41:22.703983 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-fb2ce09f-2ac5-4e4b-892f-049b6cf195e4 tempest-VolumesSnapshotTestJSON-723812961 tempest-VolumesSnapshotTestJSON-723812961-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:41:22.827572 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-fb2ce09f-2ac5-4e4b-892f-049b6cf195e4 tempest-VolumesSnapshotTestJSON-723812961 tempest-VolumesSnapshotTestJSON-723812961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '006d66ec6573443bb268408501c0aaf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bc7c74836e6485cbb5799b77faee4fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:41:22.842496 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-fb2ce09f-2ac5-4e4b-892f-049b6cf195e4 tempest-VolumesSnapshotTestJSON-723812961 tempest-VolumesSnapshotTestJSON-723812961-project] 10.222.0.30 "GET /compute/v2.1/servers/bc8e84f5-f7b3-4ad0-bccf-07f602eb239e" status: 200 len: 1289 microversion: 2.1 time: 0.164093 Jun 16 18:41:22.844131 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 467/970] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:41:22 2022] GET /compute/v2.1/servers/bc8e84f5-f7b3-4ad0-bccf-07f602eb239e => generated 1289 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:41:23.868951 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-facf864c-6f56-454e-b503-74c4dae0b690 tempest-VolumesSnapshotTestJSON-723812961 tempest-VolumesSnapshotTestJSON-723812961-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:41:23.870241 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-facf864c-6f56-454e-b503-74c4dae0b690 tempest-VolumesSnapshotTestJSON-723812961 tempest-VolumesSnapshotTestJSON-723812961-project] [instance: bc8e84f5-f7b3-4ad0-bccf-07f602eb239e] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:41:23.878110 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG dbcounter [-] [117670] Writing DB stats nova_cell1:SELECT=19,nova_cell1:INSERT=1 {{(pid=117670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:41:23.887515 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-facf864c-6f56-454e-b503-74c4dae0b690 tempest-VolumesSnapshotTestJSON-723812961 tempest-VolumesSnapshotTestJSON-723812961-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:41:23.888347 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-facf864c-6f56-454e-b503-74c4dae0b690 tempest-VolumesSnapshotTestJSON-723812961 tempest-VolumesSnapshotTestJSON-723812961-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:41:23.889712 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-facf864c-6f56-454e-b503-74c4dae0b690 tempest-VolumesSnapshotTestJSON-723812961 tempest-VolumesSnapshotTestJSON-723812961-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:41:23.890495 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-facf864c-6f56-454e-b503-74c4dae0b690 tempest-VolumesSnapshotTestJSON-723812961 tempest-VolumesSnapshotTestJSON-723812961-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:41:24.150487 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-facf864c-6f56-454e-b503-74c4dae0b690 tempest-VolumesSnapshotTestJSON-723812961 tempest-VolumesSnapshotTestJSON-723812961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '006d66ec6573443bb268408501c0aaf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bc7c74836e6485cbb5799b77faee4fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:41:24.161409 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-facf864c-6f56-454e-b503-74c4dae0b690 tempest-VolumesSnapshotTestJSON-723812961 tempest-VolumesSnapshotTestJSON-723812961-project] 10.222.0.30 "GET /compute/v2.1/servers/bc8e84f5-f7b3-4ad0-bccf-07f602eb239e" status: 200 len: 1319 microversion: 2.1 time: 0.303043 Jun 16 18:41:24.162216 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 504/971] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:41:23 2022] GET /compute/v2.1/servers/bc8e84f5-f7b3-4ad0-bccf-07f602eb239e => generated 1319 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:41:24.469269 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [req-8cdc16f6-9ff9-44ee-9b09-7cf968aa5f88 req-5aa49a24-43bd-448a-a442-13d08f4136da service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bc8e84f5-f7b3-4ad0-bccf-07f602eb239e", "tag": "f1a96929-80c6-471a-b0da-627f9f8fc0df"}]} {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:41:24.489552 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [req-8cdc16f6-9ff9-44ee-9b09-7cf968aa5f88 req-5aa49a24-43bd-448a-a442-13d08f4136da service nova] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:41:24.490722 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [req-8cdc16f6-9ff9-44ee-9b09-7cf968aa5f88 req-5aa49a24-43bd-448a-a442-13d08f4136da service nova] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:41:24.514134 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.compute.server_external_events [req-8cdc16f6-9ff9-44ee-9b09-7cf968aa5f88 req-5aa49a24-43bd-448a-a442-13d08f4136da service nova] Creating event network-changed:f1a96929-80c6-471a-b0da-627f9f8fc0df for instance bc8e84f5-f7b3-4ad0-bccf-07f602eb239e on hv-cinder-81322 Jun 16 18:41:24.525689 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [req-8cdc16f6-9ff9-44ee-9b09-7cf968aa5f88 req-5aa49a24-43bd-448a-a442-13d08f4136da service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067207 Jun 16 18:41:24.526509 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 468/972] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Jun 16 18:41:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:41:25.179578 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-87e6c915-b3e0-46c5-a082-e552e2b83de1 tempest-VolumesSnapshotTestJSON-723812961 tempest-VolumesSnapshotTestJSON-723812961-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:41:25.180218 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-87e6c915-b3e0-46c5-a082-e552e2b83de1 tempest-VolumesSnapshotTestJSON-723812961 tempest-VolumesSnapshotTestJSON-723812961-project] [instance: bc8e84f5-f7b3-4ad0-bccf-07f602eb239e] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:41:25.188011 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-87e6c915-b3e0-46c5-a082-e552e2b83de1 tempest-VolumesSnapshotTestJSON-723812961 tempest-VolumesSnapshotTestJSON-723812961-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:41:25.188522 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-87e6c915-b3e0-46c5-a082-e552e2b83de1 tempest-VolumesSnapshotTestJSON-723812961 tempest-VolumesSnapshotTestJSON-723812961-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:41:25.189317 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-87e6c915-b3e0-46c5-a082-e552e2b83de1 tempest-VolumesSnapshotTestJSON-723812961 tempest-VolumesSnapshotTestJSON-723812961-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:41:25.189759 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-87e6c915-b3e0-46c5-a082-e552e2b83de1 tempest-VolumesSnapshotTestJSON-723812961 tempest-VolumesSnapshotTestJSON-723812961-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:41:25.346323 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-87e6c915-b3e0-46c5-a082-e552e2b83de1 tempest-VolumesSnapshotTestJSON-723812961 tempest-VolumesSnapshotTestJSON-723812961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '006d66ec6573443bb268408501c0aaf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bc7c74836e6485cbb5799b77faee4fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:41:25.354800 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-87e6c915-b3e0-46c5-a082-e552e2b83de1 tempest-VolumesSnapshotTestJSON-723812961 tempest-VolumesSnapshotTestJSON-723812961-project] 10.222.0.30 "GET /compute/v2.1/servers/bc8e84f5-f7b3-4ad0-bccf-07f602eb239e" status: 200 len: 1319 microversion: 2.1 time: 0.178914 Jun 16 18:41:25.355163 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 505/973] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:41:25 2022] GET /compute/v2.1/servers/bc8e84f5-f7b3-4ad0-bccf-07f602eb239e => generated 1319 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:41:26.381960 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-8a5458fd-7920-4e4d-a271-30d8ade2ddce tempest-VolumesSnapshotTestJSON-723812961 tempest-VolumesSnapshotTestJSON-723812961-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:41:26.382486 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-8a5458fd-7920-4e4d-a271-30d8ade2ddce tempest-VolumesSnapshotTestJSON-723812961 tempest-VolumesSnapshotTestJSON-723812961-project] [instance: bc8e84f5-f7b3-4ad0-bccf-07f602eb239e] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:41:26.390340 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-8a5458fd-7920-4e4d-a271-30d8ade2ddce tempest-VolumesSnapshotTestJSON-723812961 tempest-VolumesSnapshotTestJSON-723812961-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:41:26.390791 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-8a5458fd-7920-4e4d-a271-30d8ade2ddce tempest-VolumesSnapshotTestJSON-723812961 tempest-VolumesSnapshotTestJSON-723812961-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:41:26.391586 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-8a5458fd-7920-4e4d-a271-30d8ade2ddce tempest-VolumesSnapshotTestJSON-723812961 tempest-VolumesSnapshotTestJSON-723812961-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:41:26.392025 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-8a5458fd-7920-4e4d-a271-30d8ade2ddce tempest-VolumesSnapshotTestJSON-723812961 tempest-VolumesSnapshotTestJSON-723812961-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:41:26.583390 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-8a5458fd-7920-4e4d-a271-30d8ade2ddce tempest-VolumesSnapshotTestJSON-723812961 tempest-VolumesSnapshotTestJSON-723812961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '006d66ec6573443bb268408501c0aaf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bc7c74836e6485cbb5799b77faee4fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:41:26.597040 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-8a5458fd-7920-4e4d-a271-30d8ade2ddce tempest-VolumesSnapshotTestJSON-723812961 tempest-VolumesSnapshotTestJSON-723812961-project] 10.222.0.30 "GET /compute/v2.1/servers/bc8e84f5-f7b3-4ad0-bccf-07f602eb239e" status: 200 len: 1319 microversion: 2.1 time: 0.220874 Jun 16 18:41:26.598387 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 469/974] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:41:26 2022] GET /compute/v2.1/servers/bc8e84f5-f7b3-4ad0-bccf-07f602eb239e => generated 1319 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:41:27.621859 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-53162b32-0c5d-4448-9e4c-d5b0db14e03d tempest-VolumesSnapshotTestJSON-723812961 tempest-VolumesSnapshotTestJSON-723812961-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:41:27.622695 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-53162b32-0c5d-4448-9e4c-d5b0db14e03d tempest-VolumesSnapshotTestJSON-723812961 tempest-VolumesSnapshotTestJSON-723812961-project] [instance: bc8e84f5-f7b3-4ad0-bccf-07f602eb239e] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:41:27.629735 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-53162b32-0c5d-4448-9e4c-d5b0db14e03d tempest-VolumesSnapshotTestJSON-723812961 tempest-VolumesSnapshotTestJSON-723812961-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:41:27.630192 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-53162b32-0c5d-4448-9e4c-d5b0db14e03d tempest-VolumesSnapshotTestJSON-723812961 tempest-VolumesSnapshotTestJSON-723812961-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:41:27.630990 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-53162b32-0c5d-4448-9e4c-d5b0db14e03d tempest-VolumesSnapshotTestJSON-723812961 tempest-VolumesSnapshotTestJSON-723812961-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:41:27.631430 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-53162b32-0c5d-4448-9e4c-d5b0db14e03d tempest-VolumesSnapshotTestJSON-723812961 tempest-VolumesSnapshotTestJSON-723812961-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:41:27.790090 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-53162b32-0c5d-4448-9e4c-d5b0db14e03d tempest-VolumesSnapshotTestJSON-723812961 tempest-VolumesSnapshotTestJSON-723812961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '006d66ec6573443bb268408501c0aaf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bc7c74836e6485cbb5799b77faee4fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:41:27.799138 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-53162b32-0c5d-4448-9e4c-d5b0db14e03d tempest-VolumesSnapshotTestJSON-723812961 tempest-VolumesSnapshotTestJSON-723812961-project] 10.222.0.30 "GET /compute/v2.1/servers/bc8e84f5-f7b3-4ad0-bccf-07f602eb239e" status: 200 len: 1319 microversion: 2.1 time: 0.181273 Jun 16 18:41:27.799992 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 506/975] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:41:27 2022] GET /compute/v2.1/servers/bc8e84f5-f7b3-4ad0-bccf-07f602eb239e => generated 1319 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:41:28.106731 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [req-b1a86ada-99db-411d-b19e-9c436acdeaec req-73f889d3-87a0-48a1-9cee-542f3cd39b7f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bc8e84f5-f7b3-4ad0-bccf-07f602eb239e", "name": "network-vif-plugged", "status": "completed", "tag": "f1a96929-80c6-471a-b0da-627f9f8fc0df"}]} {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:41:28.116214 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [req-b1a86ada-99db-411d-b19e-9c436acdeaec req-73f889d3-87a0-48a1-9cee-542f3cd39b7f service nova] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:41:28.116745 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [req-b1a86ada-99db-411d-b19e-9c436acdeaec req-73f889d3-87a0-48a1-9cee-542f3cd39b7f service nova] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:41:28.132155 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.compute.server_external_events [req-b1a86ada-99db-411d-b19e-9c436acdeaec req-73f889d3-87a0-48a1-9cee-542f3cd39b7f service nova] Creating event network-vif-plugged:f1a96929-80c6-471a-b0da-627f9f8fc0df for instance bc8e84f5-f7b3-4ad0-bccf-07f602eb239e on hv-cinder-81322 Jun 16 18:41:28.138806 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [req-b1a86ada-99db-411d-b19e-9c436acdeaec req-73f889d3-87a0-48a1-9cee-542f3cd39b7f service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036622 Jun 16 18:41:28.139624 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 470/976] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Jun 16 18:41:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:41:28.820233 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-603a957b-330c-4624-a247-af24c6369ed0 tempest-VolumesSnapshotTestJSON-723812961 tempest-VolumesSnapshotTestJSON-723812961-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:41:28.820987 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-603a957b-330c-4624-a247-af24c6369ed0 tempest-VolumesSnapshotTestJSON-723812961 tempest-VolumesSnapshotTestJSON-723812961-project] [instance: bc8e84f5-f7b3-4ad0-bccf-07f602eb239e] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:41:28.828239 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-603a957b-330c-4624-a247-af24c6369ed0 tempest-VolumesSnapshotTestJSON-723812961 tempest-VolumesSnapshotTestJSON-723812961-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:41:28.828688 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-603a957b-330c-4624-a247-af24c6369ed0 tempest-VolumesSnapshotTestJSON-723812961 tempest-VolumesSnapshotTestJSON-723812961-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:41:28.829473 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-603a957b-330c-4624-a247-af24c6369ed0 tempest-VolumesSnapshotTestJSON-723812961 tempest-VolumesSnapshotTestJSON-723812961-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:41:28.829920 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-603a957b-330c-4624-a247-af24c6369ed0 tempest-VolumesSnapshotTestJSON-723812961 tempest-VolumesSnapshotTestJSON-723812961-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:41:28.986969 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-603a957b-330c-4624-a247-af24c6369ed0 tempest-VolumesSnapshotTestJSON-723812961 tempest-VolumesSnapshotTestJSON-723812961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '006d66ec6573443bb268408501c0aaf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bc7c74836e6485cbb5799b77faee4fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:41:28.996863 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-603a957b-330c-4624-a247-af24c6369ed0 tempest-VolumesSnapshotTestJSON-723812961 tempest-VolumesSnapshotTestJSON-723812961-project] 10.222.0.30 "GET /compute/v2.1/servers/bc8e84f5-f7b3-4ad0-bccf-07f602eb239e" status: 200 len: 1319 microversion: 2.1 time: 0.180737 Jun 16 18:41:28.997468 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 507/977] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:41:28 2022] GET /compute/v2.1/servers/bc8e84f5-f7b3-4ad0-bccf-07f602eb239e => generated 1319 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:41:30.017077 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-53ed7702-b05a-4826-88b5-1be9fed9b62a tempest-VolumesSnapshotTestJSON-723812961 tempest-VolumesSnapshotTestJSON-723812961-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:41:30.017793 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-53ed7702-b05a-4826-88b5-1be9fed9b62a tempest-VolumesSnapshotTestJSON-723812961 tempest-VolumesSnapshotTestJSON-723812961-project] [instance: bc8e84f5-f7b3-4ad0-bccf-07f602eb239e] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:41:30.027959 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-53ed7702-b05a-4826-88b5-1be9fed9b62a tempest-VolumesSnapshotTestJSON-723812961 tempest-VolumesSnapshotTestJSON-723812961-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:41:30.028452 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-53ed7702-b05a-4826-88b5-1be9fed9b62a tempest-VolumesSnapshotTestJSON-723812961 tempest-VolumesSnapshotTestJSON-723812961-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:41:30.029546 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-53ed7702-b05a-4826-88b5-1be9fed9b62a tempest-VolumesSnapshotTestJSON-723812961 tempest-VolumesSnapshotTestJSON-723812961-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:41:30.030050 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-53ed7702-b05a-4826-88b5-1be9fed9b62a tempest-VolumesSnapshotTestJSON-723812961 tempest-VolumesSnapshotTestJSON-723812961-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:41:30.183509 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-53ed7702-b05a-4826-88b5-1be9fed9b62a tempest-VolumesSnapshotTestJSON-723812961 tempest-VolumesSnapshotTestJSON-723812961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '006d66ec6573443bb268408501c0aaf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bc7c74836e6485cbb5799b77faee4fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:41:30.191981 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-53ed7702-b05a-4826-88b5-1be9fed9b62a tempest-VolumesSnapshotTestJSON-723812961 tempest-VolumesSnapshotTestJSON-723812961-project] 10.222.0.30 "GET /compute/v2.1/servers/bc8e84f5-f7b3-4ad0-bccf-07f602eb239e" status: 200 len: 1507 microversion: 2.1 time: 0.179282 Jun 16 18:41:30.192599 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 471/978] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:41:30 2022] GET /compute/v2.1/servers/bc8e84f5-f7b3-4ad0-bccf-07f602eb239e => generated 1507 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:41:30.209769 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-2ca140bb-a956-4062-aa9c-42c7c9ae0bbd tempest-VolumesSnapshotTestJSON-723812961 tempest-VolumesSnapshotTestJSON-723812961-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "acd13824-f4d7-470e-9e11-4c97d925fad6", "device": "/dev/sdb"}} {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:41:30.211465 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-2ca140bb-a956-4062-aa9c-42c7c9ae0bbd tempest-VolumesSnapshotTestJSON-723812961 tempest-VolumesSnapshotTestJSON-723812961-project] [instance: bc8e84f5-f7b3-4ad0-bccf-07f602eb239e] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:41:30.219902 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-2ca140bb-a956-4062-aa9c-42c7c9ae0bbd tempest-VolumesSnapshotTestJSON-723812961 tempest-VolumesSnapshotTestJSON-723812961-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:41:30.220640 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-2ca140bb-a956-4062-aa9c-42c7c9ae0bbd tempest-VolumesSnapshotTestJSON-723812961 tempest-VolumesSnapshotTestJSON-723812961-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:41:30.221627 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-2ca140bb-a956-4062-aa9c-42c7c9ae0bbd tempest-VolumesSnapshotTestJSON-723812961 tempest-VolumesSnapshotTestJSON-723812961-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:41:30.222166 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-2ca140bb-a956-4062-aa9c-42c7c9ae0bbd tempest-VolumesSnapshotTestJSON-723812961 tempest-VolumesSnapshotTestJSON-723812961-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:41:30.533897 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-2ca140bb-a956-4062-aa9c-42c7c9ae0bbd tempest-VolumesSnapshotTestJSON-723812961 tempest-VolumesSnapshotTestJSON-723812961-project] 10.222.0.30 "POST /compute/v2.1/servers/bc8e84f5-f7b3-4ad0-bccf-07f602eb239e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.327769 Jun 16 18:41:30.534542 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 508/979] 10.222.0.30 () {60 vars in 1322 bytes} [Thu Jun 16 18:41:30 2022] POST /compute/v2.1/servers/bc8e84f5-f7b3-4ad0-bccf-07f602eb239e/os-volume_attachments => generated 194 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:41:47.100507 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-eb054a4a-798b-4869-866b-a1e87de8ce66 tempest-VolumesSnapshotTestJSON-723812961 tempest-VolumesSnapshotTestJSON-723812961-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:41:47.101696 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-eb054a4a-798b-4869-866b-a1e87de8ce66 tempest-VolumesSnapshotTestJSON-723812961 tempest-VolumesSnapshotTestJSON-723812961-project] [instance: bc8e84f5-f7b3-4ad0-bccf-07f602eb239e] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:41:47.104284 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG dbcounter [-] [117671] Writing DB stats nova_cell0:SELECT=2 {{(pid=117671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:41:47.105938 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG dbcounter [-] [117671] Writing DB stats nova_cell0:SELECT=6 {{(pid=117671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:41:47.106749 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG dbcounter [-] [117671] Writing DB stats nova_api:SELECT=36,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=117671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:41:47.107802 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG dbcounter [-] [117671] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:41:47.117610 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-eb054a4a-798b-4869-866b-a1e87de8ce66 tempest-VolumesSnapshotTestJSON-723812961 tempest-VolumesSnapshotTestJSON-723812961-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:41:47.118166 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-eb054a4a-798b-4869-866b-a1e87de8ce66 tempest-VolumesSnapshotTestJSON-723812961 tempest-VolumesSnapshotTestJSON-723812961-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:41:47.119082 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-eb054a4a-798b-4869-866b-a1e87de8ce66 tempest-VolumesSnapshotTestJSON-723812961 tempest-VolumesSnapshotTestJSON-723812961-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:41:47.119629 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-eb054a4a-798b-4869-866b-a1e87de8ce66 tempest-VolumesSnapshotTestJSON-723812961 tempest-VolumesSnapshotTestJSON-723812961-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:41:47.214820 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.objects.instance [None req-eb054a4a-798b-4869-866b-a1e87de8ce66 tempest-VolumesSnapshotTestJSON-723812961 tempest-VolumesSnapshotTestJSON-723812961-project] Lazy-loading 'services' on Instance uuid bc8e84f5-f7b3-4ad0-bccf-07f602eb239e {{(pid=117671) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 18:41:47.298507 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-eb054a4a-798b-4869-866b-a1e87de8ce66 tempest-VolumesSnapshotTestJSON-723812961 tempest-VolumesSnapshotTestJSON-723812961-project] 10.222.0.30 "DELETE /compute/v2.1/servers/bc8e84f5-f7b3-4ad0-bccf-07f602eb239e/os-volume_attachments/acd13824-f4d7-470e-9e11-4c97d925fad6" status: 202 len: 0 microversion: 2.1 time: 0.202055 Jun 16 18:41:47.299346 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 472/980] 10.222.0.30 () {58 vars in 1415 bytes} [Thu Jun 16 18:41:47 2022] DELETE /compute/v2.1/servers/bc8e84f5-f7b3-4ad0-bccf-07f602eb239e/os-volume_attachments/acd13824-f4d7-470e-9e11-4c97d925fad6 => generated 0 bytes in 204 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 16 18:41:48.438758 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-8a751dfa-1834-4703-bf04-08452ce4512a tempest-VolumesSnapshotTestJSON-723812961 tempest-VolumesSnapshotTestJSON-723812961-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:41:48.439831 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-8a751dfa-1834-4703-bf04-08452ce4512a tempest-VolumesSnapshotTestJSON-723812961 tempest-VolumesSnapshotTestJSON-723812961-project] [instance: bc8e84f5-f7b3-4ad0-bccf-07f602eb239e] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:41:48.442031 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG dbcounter [-] [117670] Writing DB stats nova_cell0:SELECT=2 {{(pid=117670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:41:48.442749 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG dbcounter [-] [117670] Writing DB stats nova_api:SELECT=22 {{(pid=117670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:41:48.443409 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG dbcounter [-] [117670] Writing DB stats nova_cell1:SELECT=35,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:41:48.451681 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-8a751dfa-1834-4703-bf04-08452ce4512a tempest-VolumesSnapshotTestJSON-723812961 tempest-VolumesSnapshotTestJSON-723812961-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:41:48.452358 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-8a751dfa-1834-4703-bf04-08452ce4512a tempest-VolumesSnapshotTestJSON-723812961 tempest-VolumesSnapshotTestJSON-723812961-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:41:48.453293 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-8a751dfa-1834-4703-bf04-08452ce4512a tempest-VolumesSnapshotTestJSON-723812961 tempest-VolumesSnapshotTestJSON-723812961-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:41:48.453883 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-8a751dfa-1834-4703-bf04-08452ce4512a tempest-VolumesSnapshotTestJSON-723812961 tempest-VolumesSnapshotTestJSON-723812961-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:41:48.486362 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-8a751dfa-1834-4703-bf04-08452ce4512a tempest-VolumesSnapshotTestJSON-723812961 tempest-VolumesSnapshotTestJSON-723812961-project] [instance: bc8e84f5-f7b3-4ad0-bccf-07f602eb239e] Going to try to terminate instance {{(pid=117670) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 18:41:48.594033 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-8a751dfa-1834-4703-bf04-08452ce4512a tempest-VolumesSnapshotTestJSON-723812961 tempest-VolumesSnapshotTestJSON-723812961-project] 10.222.0.30 "DELETE /compute/v2.1/servers/bc8e84f5-f7b3-4ad0-bccf-07f602eb239e" status: 204 len: 0 microversion: 2.1 time: 0.158891 Jun 16 18:41:48.595291 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 509/981] 10.222.0.30 () {58 vars in 1238 bytes} [Thu Jun 16 18:41:48 2022] DELETE /compute/v2.1/servers/bc8e84f5-f7b3-4ad0-bccf-07f602eb239e => generated 0 bytes in 162 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 18:41:48.607055 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-5f7bc8b0-6bf1-4c7d-b480-d57d3e2c1980 tempest-VolumesSnapshotTestJSON-723812961 tempest-VolumesSnapshotTestJSON-723812961-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:41:48.607789 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-5f7bc8b0-6bf1-4c7d-b480-d57d3e2c1980 tempest-VolumesSnapshotTestJSON-723812961 tempest-VolumesSnapshotTestJSON-723812961-project] [instance: bc8e84f5-f7b3-4ad0-bccf-07f602eb239e] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:41:48.615344 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-5f7bc8b0-6bf1-4c7d-b480-d57d3e2c1980 tempest-VolumesSnapshotTestJSON-723812961 tempest-VolumesSnapshotTestJSON-723812961-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:41:48.615839 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-5f7bc8b0-6bf1-4c7d-b480-d57d3e2c1980 tempest-VolumesSnapshotTestJSON-723812961 tempest-VolumesSnapshotTestJSON-723812961-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:41:48.616723 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-5f7bc8b0-6bf1-4c7d-b480-d57d3e2c1980 tempest-VolumesSnapshotTestJSON-723812961 tempest-VolumesSnapshotTestJSON-723812961-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:41:48.617166 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-5f7bc8b0-6bf1-4c7d-b480-d57d3e2c1980 tempest-VolumesSnapshotTestJSON-723812961 tempest-VolumesSnapshotTestJSON-723812961-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:41:48.787130 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-5f7bc8b0-6bf1-4c7d-b480-d57d3e2c1980 tempest-VolumesSnapshotTestJSON-723812961 tempest-VolumesSnapshotTestJSON-723812961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '006d66ec6573443bb268408501c0aaf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bc7c74836e6485cbb5799b77faee4fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:41:48.796719 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-5f7bc8b0-6bf1-4c7d-b480-d57d3e2c1980 tempest-VolumesSnapshotTestJSON-723812961 tempest-VolumesSnapshotTestJSON-723812961-project] 10.222.0.30 "GET /compute/v2.1/servers/bc8e84f5-f7b3-4ad0-bccf-07f602eb239e" status: 200 len: 1513 microversion: 2.1 time: 0.194837 Jun 16 18:41:48.797323 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 473/982] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:41:48 2022] GET /compute/v2.1/servers/bc8e84f5-f7b3-4ad0-bccf-07f602eb239e => generated 1513 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:41:49.816419 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-2e254da9-a3d0-43da-a221-5ee88c49e097 tempest-VolumesSnapshotTestJSON-723812961 tempest-VolumesSnapshotTestJSON-723812961-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:41:49.817110 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-2e254da9-a3d0-43da-a221-5ee88c49e097 tempest-VolumesSnapshotTestJSON-723812961 tempest-VolumesSnapshotTestJSON-723812961-project] [instance: bc8e84f5-f7b3-4ad0-bccf-07f602eb239e] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:41:49.826186 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-2e254da9-a3d0-43da-a221-5ee88c49e097 tempest-VolumesSnapshotTestJSON-723812961 tempest-VolumesSnapshotTestJSON-723812961-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:41:49.826793 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-2e254da9-a3d0-43da-a221-5ee88c49e097 tempest-VolumesSnapshotTestJSON-723812961 tempest-VolumesSnapshotTestJSON-723812961-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:41:49.827692 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-2e254da9-a3d0-43da-a221-5ee88c49e097 tempest-VolumesSnapshotTestJSON-723812961 tempest-VolumesSnapshotTestJSON-723812961-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:41:49.828314 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-2e254da9-a3d0-43da-a221-5ee88c49e097 tempest-VolumesSnapshotTestJSON-723812961 tempest-VolumesSnapshotTestJSON-723812961-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:41:49.999174 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-2e254da9-a3d0-43da-a221-5ee88c49e097 tempest-VolumesSnapshotTestJSON-723812961 tempest-VolumesSnapshotTestJSON-723812961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '006d66ec6573443bb268408501c0aaf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bc7c74836e6485cbb5799b77faee4fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:41:50.010089 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-2e254da9-a3d0-43da-a221-5ee88c49e097 tempest-VolumesSnapshotTestJSON-723812961 tempest-VolumesSnapshotTestJSON-723812961-project] 10.222.0.30 "GET /compute/v2.1/servers/bc8e84f5-f7b3-4ad0-bccf-07f602eb239e" status: 200 len: 1513 microversion: 2.1 time: 0.198421 Jun 16 18:41:50.010732 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 510/983] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:41:49 2022] GET /compute/v2.1/servers/bc8e84f5-f7b3-4ad0-bccf-07f602eb239e => generated 1513 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:41:50.920817 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [req-16813a36-bff3-4088-b8f9-6daee20e02d4 req-7bdbc25f-327e-4364-82c4-26241551c1ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bc8e84f5-f7b3-4ad0-bccf-07f602eb239e", "name": "network-vif-deleted", "tag": "f1a96929-80c6-471a-b0da-627f9f8fc0df"}]} {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:41:50.935005 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [req-16813a36-bff3-4088-b8f9-6daee20e02d4 req-7bdbc25f-327e-4364-82c4-26241551c1ee service nova] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:41:50.935818 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [req-16813a36-bff3-4088-b8f9-6daee20e02d4 req-7bdbc25f-327e-4364-82c4-26241551c1ee service nova] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:41:50.953613 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.compute.server_external_events [req-16813a36-bff3-4088-b8f9-6daee20e02d4 req-7bdbc25f-327e-4364-82c4-26241551c1ee service nova] Creating event network-vif-deleted:f1a96929-80c6-471a-b0da-627f9f8fc0df for instance bc8e84f5-f7b3-4ad0-bccf-07f602eb239e on hv-cinder-81322 Jun 16 18:41:50.963024 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [req-16813a36-bff3-4088-b8f9-6daee20e02d4 req-7bdbc25f-327e-4364-82c4-26241551c1ee service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048996 Jun 16 18:41:50.964463 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 474/984] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Jun 16 18:41:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:41:51.030072 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-7bb65390-8347-468a-8c24-4ec525c354db tempest-VolumesSnapshotTestJSON-723812961 tempest-VolumesSnapshotTestJSON-723812961-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:41:51.031095 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-7bb65390-8347-468a-8c24-4ec525c354db tempest-VolumesSnapshotTestJSON-723812961 tempest-VolumesSnapshotTestJSON-723812961-project] [instance: bc8e84f5-f7b3-4ad0-bccf-07f602eb239e] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:41:51.039141 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-7bb65390-8347-468a-8c24-4ec525c354db tempest-VolumesSnapshotTestJSON-723812961 tempest-VolumesSnapshotTestJSON-723812961-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:41:51.039721 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-7bb65390-8347-468a-8c24-4ec525c354db tempest-VolumesSnapshotTestJSON-723812961 tempest-VolumesSnapshotTestJSON-723812961-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:41:51.040659 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-7bb65390-8347-468a-8c24-4ec525c354db tempest-VolumesSnapshotTestJSON-723812961 tempest-VolumesSnapshotTestJSON-723812961-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:41:51.041197 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-7bb65390-8347-468a-8c24-4ec525c354db tempest-VolumesSnapshotTestJSON-723812961 tempest-VolumesSnapshotTestJSON-723812961-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:41:51.080722 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-7bb65390-8347-468a-8c24-4ec525c354db tempest-VolumesSnapshotTestJSON-723812961 tempest-VolumesSnapshotTestJSON-723812961-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:41:51.081143 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-7bb65390-8347-468a-8c24-4ec525c354db tempest-VolumesSnapshotTestJSON-723812961 tempest-VolumesSnapshotTestJSON-723812961-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:41:51.081603 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.objects.instance [None req-7bb65390-8347-468a-8c24-4ec525c354db tempest-VolumesSnapshotTestJSON-723812961 tempest-VolumesSnapshotTestJSON-723812961-project] Lazy-loading 'fault' on Instance uuid bc8e84f5-f7b3-4ad0-bccf-07f602eb239e {{(pid=117670) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 18:41:51.128421 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-7bb65390-8347-468a-8c24-4ec525c354db tempest-VolumesSnapshotTestJSON-723812961 tempest-VolumesSnapshotTestJSON-723812961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '006d66ec6573443bb268408501c0aaf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bc7c74836e6485cbb5799b77faee4fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:41:51.137416 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-7bb65390-8347-468a-8c24-4ec525c354db tempest-VolumesSnapshotTestJSON-723812961 tempest-VolumesSnapshotTestJSON-723812961-project] 10.222.0.30 "GET /compute/v2.1/servers/bc8e84f5-f7b3-4ad0-bccf-07f602eb239e" status: 200 len: 1309 microversion: 2.1 time: 0.112724 Jun 16 18:41:51.138020 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 511/985] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:41:51 2022] GET /compute/v2.1/servers/bc8e84f5-f7b3-4ad0-bccf-07f602eb239e => generated 1309 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:41:52.157533 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-12c0df4f-45b9-4ed3-a324-60c580e02067 tempest-VolumesSnapshotTestJSON-723812961 tempest-VolumesSnapshotTestJSON-723812961-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:41:52.158244 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-12c0df4f-45b9-4ed3-a324-60c580e02067 tempest-VolumesSnapshotTestJSON-723812961 tempest-VolumesSnapshotTestJSON-723812961-project] [instance: bc8e84f5-f7b3-4ad0-bccf-07f602eb239e] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:41:52.165145 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-12c0df4f-45b9-4ed3-a324-60c580e02067 tempest-VolumesSnapshotTestJSON-723812961 tempest-VolumesSnapshotTestJSON-723812961-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:41:52.165596 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-12c0df4f-45b9-4ed3-a324-60c580e02067 tempest-VolumesSnapshotTestJSON-723812961 tempest-VolumesSnapshotTestJSON-723812961-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:41:52.166372 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-12c0df4f-45b9-4ed3-a324-60c580e02067 tempest-VolumesSnapshotTestJSON-723812961 tempest-VolumesSnapshotTestJSON-723812961-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:41:52.166806 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-12c0df4f-45b9-4ed3-a324-60c580e02067 tempest-VolumesSnapshotTestJSON-723812961 tempest-VolumesSnapshotTestJSON-723812961-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:41:52.184252 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.wsgi [None req-12c0df4f-45b9-4ed3-a324-60c580e02067 tempest-VolumesSnapshotTestJSON-723812961 tempest-VolumesSnapshotTestJSON-723812961-project] HTTP exception thrown: Instance bc8e84f5-f7b3-4ad0-bccf-07f602eb239e could not be found. Jun 16 18:41:52.185949 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-12c0df4f-45b9-4ed3-a324-60c580e02067 tempest-VolumesSnapshotTestJSON-723812961 tempest-VolumesSnapshotTestJSON-723812961-project] Request method failure captured: Jun 16 18:41:52.185949 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: request: GET /compute/v2.1/servers/bc8e84f5-f7b3-4ad0-bccf-07f602eb239e HTTP/1.1 Jun 16 18:41:52.185949 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: Accept: application/json Jun 16 18:41:52.185949 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: Accept-Encoding: identity Jun 16 18:41:52.185949 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: Connection: close Jun 16 18:41:52.185949 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: Content-Length: 0 Jun 16 18:41:52.185949 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: Content-Type: application/json Jun 16 18:41:52.185949 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: Host: 10.222.0.30 Jun 16 18:41:52.185949 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: Openstack-System-Scope: None Jun 16 18:41:52.185949 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: User-Agent: python-urllib3/1.26.9 Jun 16 18:41:52.185949 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Auth-Token: gAAAAABiq3kQdW6OEEk-N_f3iVrgZ5DB5eDkeYO-gjnu70pO_CbEms21M3EL_0b6ZjwT9HgmeDRh_HeTe5S8DHkNzrYN9z_NXnbakIhFgWhunjlhjMzOtAKV1VoWODFo59lJo5bZy9rjUiEAI59X2Wli4BEUEExUV9esmgId1pKY53ZJVxvFMB8 Jun 16 18:41:52.185949 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Domain-Id: None Jun 16 18:41:52.185949 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Domain-Name: None Jun 16 18:41:52.185949 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Identity-Status: Confirmed Jun 16 18:41:52.185949 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Is-Admin-Project: True Jun 16 18:41:52.185949 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Project-Domain-Id: default Jun 16 18:41:52.185949 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Project-Domain-Name: Default Jun 16 18:41:52.185949 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Project-Id: 3bc7c74836e6485cbb5799b77faee4fd Jun 16 18:41:52.185949 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Project-Name: tempest-VolumesSnapshotTestJSON-723812961 Jun 16 18:41:52.185949 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Role: reader,member Jun 16 18:41:52.185949 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Roles: reader,member Jun 16 18:41:52.188367 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/3bc7c74836e6485cbb5799b77faee4fd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/3bc7c74836e6485cbb5799b77faee4fd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_3bc7c74836e6485cbb5799b77faee4fd", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/3bc7c74836e6485cbb5799b77faee4fd"}]}] Jun 16 18:41:52.188367 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Tenant: tempest-VolumesSnapshotTestJSON-723812961 Jun 16 18:41:52.188367 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Tenant-Id: 3bc7c74836e6485cbb5799b77faee4fd Jun 16 18:41:52.188367 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-723812961 Jun 16 18:41:52.188367 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-User: tempest-VolumesSnapshotTestJSON-723812961-project Jun 16 18:41:52.188367 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-User-Domain-Id: default Jun 16 18:41:52.188367 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-User-Domain-Name: Default Jun 16 18:41:52.188367 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-User-Id: 006d66ec6573443bb268408501c0aaf3 Jun 16 18:41:52.188367 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-User-Name: tempest-VolumesSnapshotTestJSON-723812961-project Jun 16 18:41:52.188367 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: method: > Jun 16 18:41:52.188367 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: exception: Instance bc8e84f5-f7b3-4ad0-bccf-07f602eb239e could not be found. Jun 16 18:41:52.188367 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: action_args: {'id': 'bc8e84f5-f7b3-4ad0-bccf-07f602eb239e'} Jun 16 18:41:52.189834 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:41:52.189834 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:41:52.189834 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 18:41:52.189834 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 18:41:52.189834 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 18:41:52.189834 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 18:41:52.189834 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 18:41:52.189834 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 18:41:52.189834 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 18:41:52.189834 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 18:41:52.189834 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bc8e84f5-f7b3-4ad0-bccf-07f602eb239e could not be found. Jun 16 18:41:52.189834 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Jun 16 18:41:52.189834 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:41:52.189834 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Jun 16 18:41:52.189834 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:41:52.189834 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:41:52.189834 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:41:52.189834 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:41:52.189834 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:41:52.189834 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:41:52.192756 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:41:52.192756 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 18:41:52.192756 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 18:41:52.192756 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 18:41:52.192756 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 18:41:52.192756 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 18:41:52.192756 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:41:52.192756 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bc8e84f5-f7b3-4ad0-bccf-07f602eb239e could not be found. Jun 16 18:41:52.192756 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Jun 16 18:41:52.192756 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:41:52.192756 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Jun 16 18:41:52.192756 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:41:52.192756 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:41:52.192756 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:41:52.192756 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:41:52.192756 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:41:52.192756 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bc8e84f5-f7b3-4ad0-bccf-07f602eb239e could not be found. Jun 16 18:41:52.192756 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Jun 16 18:41:52.195474 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-12c0df4f-45b9-4ed3-a324-60c580e02067 tempest-VolumesSnapshotTestJSON-723812961 tempest-VolumesSnapshotTestJSON-723812961-project] Returning 404 to user: Instance bc8e84f5-f7b3-4ad0-bccf-07f602eb239e could not be found. {{(pid=117671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:41:52.195474 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-12c0df4f-45b9-4ed3-a324-60c580e02067 tempest-VolumesSnapshotTestJSON-723812961 tempest-VolumesSnapshotTestJSON-723812961-project] 10.222.0.30 "GET /compute/v2.1/servers/bc8e84f5-f7b3-4ad0-bccf-07f602eb239e" status: 404 len: 111 microversion: 2.1 time: 0.035548 Jun 16 18:41:52.195474 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 475/986] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:41:52 2022] GET /compute/v2.1/servers/bc8e84f5-f7b3-4ad0-bccf-07f602eb239e => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:42:00.866194 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 16 18:42:00.866973 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: Thu Jun 16 18:42:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 16 18:42:07.927903 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-184e0e17-43b7-47a3-80b2-2f3d3bb6aad8 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:42:07.928624 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-184e0e17-43b7-47a3-80b2-2f3d3bb6aad8 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] [instance: d7463e71-d7d9-406e-97b0-5ab1dc992c9b] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:42:07.930680 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG dbcounter [-] [117670] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=117670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:42:07.931334 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG dbcounter [-] [117670] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:42:07.938730 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-184e0e17-43b7-47a3-80b2-2f3d3bb6aad8 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:07.939178 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-184e0e17-43b7-47a3-80b2-2f3d3bb6aad8 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:07.939997 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-184e0e17-43b7-47a3-80b2-2f3d3bb6aad8 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:07.940920 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-184e0e17-43b7-47a3-80b2-2f3d3bb6aad8 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:07.970304 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-184e0e17-43b7-47a3-80b2-2f3d3bb6aad8 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] [instance: d7463e71-d7d9-406e-97b0-5ab1dc992c9b] Going to try to terminate instance {{(pid=117670) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 18:42:08.066679 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-184e0e17-43b7-47a3-80b2-2f3d3bb6aad8 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] 10.222.0.30 "DELETE /compute/v2.1/servers/d7463e71-d7d9-406e-97b0-5ab1dc992c9b" status: 204 len: 0 microversion: 2.1 time: 0.143039 Jun 16 18:42:08.067528 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 512/987] 10.222.0.30 () {58 vars in 1238 bytes} [Thu Jun 16 18:42:07 2022] DELETE /compute/v2.1/servers/d7463e71-d7d9-406e-97b0-5ab1dc992c9b => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 16 18:42:08.076522 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-6a2704ed-a97a-4400-ac62-e08022b9324f tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:42:08.077257 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-6a2704ed-a97a-4400-ac62-e08022b9324f tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] [instance: d7463e71-d7d9-406e-97b0-5ab1dc992c9b] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:42:08.080153 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG dbcounter [-] [117671] Writing DB stats nova_api:SELECT=8 {{(pid=117671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:42:08.084446 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG dbcounter [-] [117671] Writing DB stats nova_cell1:SELECT=19,nova_cell1:INSERT=1 {{(pid=117671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:42:08.086745 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-6a2704ed-a97a-4400-ac62-e08022b9324f tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:08.087211 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-6a2704ed-a97a-4400-ac62-e08022b9324f tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:08.088075 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-6a2704ed-a97a-4400-ac62-e08022b9324f tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:08.089223 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-6a2704ed-a97a-4400-ac62-e08022b9324f tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:08.294226 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-6a2704ed-a97a-4400-ac62-e08022b9324f tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5cbf8d443de4a9fb627ef316fbd033f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff4784f6ab3499b88cb38c81780b754', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:42:08.306487 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-6a2704ed-a97a-4400-ac62-e08022b9324f tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] 10.222.0.30 "GET /compute/v2.1/servers/d7463e71-d7d9-406e-97b0-5ab1dc992c9b" status: 200 len: 1580 microversion: 2.1 time: 0.234432 Jun 16 18:42:08.307081 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 476/988] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:42:08 2022] GET /compute/v2.1/servers/d7463e71-d7d9-406e-97b0-5ab1dc992c9b => generated 1580 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:42:09.327671 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-308b74f3-9cf4-46e9-99ea-d022e2667fb9 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:42:09.328405 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-308b74f3-9cf4-46e9-99ea-d022e2667fb9 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] [instance: d7463e71-d7d9-406e-97b0-5ab1dc992c9b] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:42:09.336402 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-308b74f3-9cf4-46e9-99ea-d022e2667fb9 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:09.336954 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-308b74f3-9cf4-46e9-99ea-d022e2667fb9 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:09.337906 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-308b74f3-9cf4-46e9-99ea-d022e2667fb9 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:09.338416 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-308b74f3-9cf4-46e9-99ea-d022e2667fb9 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:09.524752 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-308b74f3-9cf4-46e9-99ea-d022e2667fb9 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5cbf8d443de4a9fb627ef316fbd033f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff4784f6ab3499b88cb38c81780b754', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:42:09.538926 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-308b74f3-9cf4-46e9-99ea-d022e2667fb9 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] 10.222.0.30 "GET /compute/v2.1/servers/d7463e71-d7d9-406e-97b0-5ab1dc992c9b" status: 200 len: 1580 microversion: 2.1 time: 0.216524 Jun 16 18:42:09.540097 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 513/989] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:42:09 2022] GET /compute/v2.1/servers/d7463e71-d7d9-406e-97b0-5ab1dc992c9b => generated 1580 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:42:10.566441 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-3dbc3ecc-b58a-478a-be47-898c6554c6d0 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:42:10.567205 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-3dbc3ecc-b58a-478a-be47-898c6554c6d0 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] [instance: d7463e71-d7d9-406e-97b0-5ab1dc992c9b] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:42:10.575581 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-3dbc3ecc-b58a-478a-be47-898c6554c6d0 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:10.576039 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-3dbc3ecc-b58a-478a-be47-898c6554c6d0 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:10.576880 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-3dbc3ecc-b58a-478a-be47-898c6554c6d0 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:10.577326 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-3dbc3ecc-b58a-478a-be47-898c6554c6d0 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:10.652512 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-3dbc3ecc-b58a-478a-be47-898c6554c6d0 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5cbf8d443de4a9fb627ef316fbd033f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff4784f6ab3499b88cb38c81780b754', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:42:10.664841 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-3dbc3ecc-b58a-478a-be47-898c6554c6d0 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] 10.222.0.30 "GET /compute/v2.1/servers/d7463e71-d7d9-406e-97b0-5ab1dc992c9b" status: 200 len: 1512 microversion: 2.1 time: 0.102740 Jun 16 18:42:10.665425 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 477/990] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:42:10 2022] GET /compute/v2.1/servers/d7463e71-d7d9-406e-97b0-5ab1dc992c9b => generated 1512 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:42:10.900574 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [req-b5424767-c51f-4c30-b396-3fe57ef27c82 req-f20feb38-895e-4cd7-922c-50e5d2285583 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7463e71-d7d9-406e-97b0-5ab1dc992c9b", "name": "network-vif-deleted", "tag": "fb36aaba-0fd0-42b5-b9ac-2f6112753d35"}]} {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:42:10.921484 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [req-b5424767-c51f-4c30-b396-3fe57ef27c82 req-f20feb38-895e-4cd7-922c-50e5d2285583 service nova] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:10.922301 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [req-b5424767-c51f-4c30-b396-3fe57ef27c82 req-f20feb38-895e-4cd7-922c-50e5d2285583 service nova] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:10.955900 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.compute.server_external_events [req-b5424767-c51f-4c30-b396-3fe57ef27c82 req-f20feb38-895e-4cd7-922c-50e5d2285583 service nova] Creating event network-vif-deleted:fb36aaba-0fd0-42b5-b9ac-2f6112753d35 for instance d7463e71-d7d9-406e-97b0-5ab1dc992c9b on hv-cinder-81322 Jun 16 18:42:10.971102 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [req-b5424767-c51f-4c30-b396-3fe57ef27c82 req-f20feb38-895e-4cd7-922c-50e5d2285583 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079000 Jun 16 18:42:10.979155 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 514/991] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Jun 16 18:42:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 18:42:11.685699 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-1872ec87-f680-446f-a8c5-ca8de1321edb tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:42:11.687102 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-1872ec87-f680-446f-a8c5-ca8de1321edb tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] [instance: d7463e71-d7d9-406e-97b0-5ab1dc992c9b] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:42:11.696717 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-1872ec87-f680-446f-a8c5-ca8de1321edb tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:11.697609 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-1872ec87-f680-446f-a8c5-ca8de1321edb tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:11.699080 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-1872ec87-f680-446f-a8c5-ca8de1321edb tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:11.699875 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-1872ec87-f680-446f-a8c5-ca8de1321edb tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:11.727584 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.wsgi [None req-1872ec87-f680-446f-a8c5-ca8de1321edb tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] HTTP exception thrown: Instance d7463e71-d7d9-406e-97b0-5ab1dc992c9b could not be found. Jun 16 18:42:11.731818 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-1872ec87-f680-446f-a8c5-ca8de1321edb tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Request method failure captured: Jun 16 18:42:11.731818 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: request: GET /compute/v2.1/servers/d7463e71-d7d9-406e-97b0-5ab1dc992c9b HTTP/1.1 Jun 16 18:42:11.731818 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: Accept: application/json Jun 16 18:42:11.731818 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: Accept-Encoding: identity Jun 16 18:42:11.731818 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: Connection: close Jun 16 18:42:11.731818 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: Content-Length: 0 Jun 16 18:42:11.731818 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: Content-Type: application/json Jun 16 18:42:11.731818 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: Host: 10.222.0.30 Jun 16 18:42:11.731818 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: Openstack-System-Scope: None Jun 16 18:42:11.731818 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: User-Agent: python-urllib3/1.26.9 Jun 16 18:42:11.731818 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Auth-Token: gAAAAABiq3jY4R2XLaMoSQFIu108GrgbWK1ZzxrQvtOfRnw0Fi7O9DZ8rIZHp31j8YpKZy1pG3APpQTkFQ8ZcpOFpRMLDOipcXGngfnUS2RmLkdps5xgUNxPEFSLbWH5Xb-i7Mi-7CjVAaASuV92Mj_CZi7D75bg6gQCu-jW8y7G9SDpsOOfj5o Jun 16 18:42:11.731818 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Domain-Id: None Jun 16 18:42:11.731818 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Domain-Name: None Jun 16 18:42:11.731818 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Identity-Status: Confirmed Jun 16 18:42:11.731818 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Is-Admin-Project: True Jun 16 18:42:11.731818 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Project-Domain-Id: default Jun 16 18:42:11.731818 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Project-Domain-Name: Default Jun 16 18:42:11.731818 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Project-Id: dff4784f6ab3499b88cb38c81780b754 Jun 16 18:42:11.731818 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Project-Name: tempest-TestVolumeBootPattern-539061139 Jun 16 18:42:11.731818 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Role: reader,member Jun 16 18:42:11.731818 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Roles: reader,member Jun 16 18:42:11.733716 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/dff4784f6ab3499b88cb38c81780b754"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/dff4784f6ab3499b88cb38c81780b754"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_dff4784f6ab3499b88cb38c81780b754", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/dff4784f6ab3499b88cb38c81780b754"}]}] Jun 16 18:42:11.733716 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Tenant: tempest-TestVolumeBootPattern-539061139 Jun 16 18:42:11.733716 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Tenant-Id: dff4784f6ab3499b88cb38c81780b754 Jun 16 18:42:11.733716 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Tenant-Name: tempest-TestVolumeBootPattern-539061139 Jun 16 18:42:11.733716 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-User: tempest-TestVolumeBootPattern-539061139-project Jun 16 18:42:11.733716 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-User-Domain-Id: default Jun 16 18:42:11.733716 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-User-Domain-Name: Default Jun 16 18:42:11.733716 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-User-Id: e5cbf8d443de4a9fb627ef316fbd033f Jun 16 18:42:11.733716 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-User-Name: tempest-TestVolumeBootPattern-539061139-project Jun 16 18:42:11.733716 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: method: > Jun 16 18:42:11.733716 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: exception: Instance d7463e71-d7d9-406e-97b0-5ab1dc992c9b could not be found. Jun 16 18:42:11.733716 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: action_args: {'id': 'd7463e71-d7d9-406e-97b0-5ab1dc992c9b'} Jun 16 18:42:11.734536 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:42:11.734536 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:42:11.734536 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 18:42:11.734536 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 18:42:11.734536 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 18:42:11.734536 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 18:42:11.734536 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 18:42:11.734536 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 18:42:11.734536 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 18:42:11.734536 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 18:42:11.734536 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d7463e71-d7d9-406e-97b0-5ab1dc992c9b could not be found. Jun 16 18:42:11.734536 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Jun 16 18:42:11.734536 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:42:11.734536 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Jun 16 18:42:11.734536 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:42:11.734536 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:42:11.734536 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:42:11.734536 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:42:11.734536 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:42:11.734536 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:42:11.736002 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:42:11.736002 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 18:42:11.736002 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 18:42:11.736002 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 18:42:11.736002 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 18:42:11.736002 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 18:42:11.736002 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:42:11.736002 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d7463e71-d7d9-406e-97b0-5ab1dc992c9b could not be found. Jun 16 18:42:11.736002 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Jun 16 18:42:11.736002 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:42:11.736002 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Jun 16 18:42:11.736002 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:42:11.736002 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:42:11.736002 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:42:11.736002 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:42:11.736002 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:42:11.736002 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d7463e71-d7d9-406e-97b0-5ab1dc992c9b could not be found. Jun 16 18:42:11.736002 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Jun 16 18:42:11.737499 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-1872ec87-f680-446f-a8c5-ca8de1321edb tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Returning 404 to user: Instance d7463e71-d7d9-406e-97b0-5ab1dc992c9b could not be found. {{(pid=117671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:42:11.737499 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-1872ec87-f680-446f-a8c5-ca8de1321edb tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] 10.222.0.30 "GET /compute/v2.1/servers/d7463e71-d7d9-406e-97b0-5ab1dc992c9b" status: 404 len: 111 microversion: 2.1 time: 0.054832 Jun 16 18:42:11.737499 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 478/992] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:42:11 2022] GET /compute/v2.1/servers/d7463e71-d7d9-406e-97b0-5ab1dc992c9b => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:42:11.887777 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-819ab24f-a7d7-4d3d-aa0b-60efca3e3d0f tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-405129758", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1062823508", "security_groups": [{"name": "tempest-secgroup-smoke-1290455754"}], "block_device_mapping_v2": [{"uuid": "6ae275ac-3f9a-48bb-9fd1-d2a32027967c", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "b0cbaebd-d55a-4d35-baec-5307687a93e6"}]}} {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:42:12.099975 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.network.neutron [None req-819ab24f-a7d7-4d3d-aa0b-60efca3e3d0f tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] validate_networks() for [('b0cbaebd-d55a-4d35-baec-5307687a93e6', None, None, None, None, None)] {{(pid=117670) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 18:42:12.619626 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.virt.hardware [None req-819ab24f-a7d7-4d3d-aa0b-60efca3e3d0f tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Flavor limits 0:0:0 {{(pid=117670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 18:42:12.620560 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.virt.hardware [None req-819ab24f-a7d7-4d3d-aa0b-60efca3e3d0f tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Image limits 0:0:0 {{(pid=117670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 18:42:12.621444 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.virt.hardware [None req-819ab24f-a7d7-4d3d-aa0b-60efca3e3d0f tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Flavor pref 0:0:0 {{(pid=117670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 18:42:12.622172 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.virt.hardware [None req-819ab24f-a7d7-4d3d-aa0b-60efca3e3d0f tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Image pref 0:0:0 {{(pid=117670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 18:42:12.622937 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.virt.hardware [None req-819ab24f-a7d7-4d3d-aa0b-60efca3e3d0f tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 18:42:12.633773 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-819ab24f-a7d7-4d3d-aa0b-60efca3e3d0f tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:12.634374 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-819ab24f-a7d7-4d3d-aa0b-60efca3e3d0f tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:12.635298 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-819ab24f-a7d7-4d3d-aa0b-60efca3e3d0f tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:12.636679 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-819ab24f-a7d7-4d3d-aa0b-60efca3e3d0f tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:12.658201 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.quota [None req-819ab24f-a7d7-4d3d-aa0b-60efca3e3d0f tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Getting quotas for project dff4784f6ab3499b88cb38c81780b754. Resources: {'instances', 'ram', 'cores'} {{(pid=117670) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 18:42:12.663010 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.quota [None req-819ab24f-a7d7-4d3d-aa0b-60efca3e3d0f tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Getting quotas for user e5cbf8d443de4a9fb627ef316fbd033f and project dff4784f6ab3499b88cb38c81780b754. Resources: {'instances', 'ram', 'cores'} {{(pid=117670) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 18:42:12.736109 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-819ab24f-a7d7-4d3d-aa0b-60efca3e3d0f tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Going to run 1 instances... {{(pid=117670) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 18:42:12.739413 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-819ab24f-a7d7-4d3d-aa0b-60efca3e3d0f tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] [instance: 07a8c30d-1b9a-422f-83c3-be1fa6bffe05] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='6ae275ac-3f9a-48bb-9fd1-d2a32027967c',volume_size=None,volume_type=None)] {{(pid=117670) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 18:42:12.896477 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-819ab24f-a7d7-4d3d-aa0b-60efca3e3d0f tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.013622 Jun 16 18:42:12.897643 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 515/993] 10.222.0.30 () {60 vars in 1146 bytes} [Thu Jun 16 18:42:11 2022] POST /compute/v2.1/servers => generated 406 bytes in 1016 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 16 18:42:12.912651 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-573f281f-2855-455f-921a-0f334e34f1ca tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:42:12.913947 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-573f281f-2855-455f-921a-0f334e34f1ca tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] [instance: 07a8c30d-1b9a-422f-83c3-be1fa6bffe05] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:42:12.991467 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-573f281f-2855-455f-921a-0f334e34f1ca tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5cbf8d443de4a9fb627ef316fbd033f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff4784f6ab3499b88cb38c81780b754', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:42:13.000274 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-573f281f-2855-455f-921a-0f334e34f1ca tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] 10.222.0.30 "GET /compute/v2.1/servers/07a8c30d-1b9a-422f-83c3-be1fa6bffe05" status: 200 len: 1094 microversion: 2.1 time: 0.095304 Jun 16 18:42:13.000865 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 479/994] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:42:12 2022] GET /compute/v2.1/servers/07a8c30d-1b9a-422f-83c3-be1fa6bffe05 => generated 1094 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:42:14.032818 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-2b38d209-7c73-4f11-8461-213d88549087 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:42:14.034684 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-2b38d209-7c73-4f11-8461-213d88549087 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] [instance: 07a8c30d-1b9a-422f-83c3-be1fa6bffe05] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:42:14.049554 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-2b38d209-7c73-4f11-8461-213d88549087 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:14.051181 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-2b38d209-7c73-4f11-8461-213d88549087 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:14.052656 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-2b38d209-7c73-4f11-8461-213d88549087 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:14.053568 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-2b38d209-7c73-4f11-8461-213d88549087 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:14.171606 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-2b38d209-7c73-4f11-8461-213d88549087 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5cbf8d443de4a9fb627ef316fbd033f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff4784f6ab3499b88cb38c81780b754', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:42:14.186066 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-2b38d209-7c73-4f11-8461-213d88549087 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] 10.222.0.30 "GET /compute/v2.1/servers/07a8c30d-1b9a-422f-83c3-be1fa6bffe05" status: 200 len: 1200 microversion: 2.1 time: 0.162014 Jun 16 18:42:14.187120 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 516/995] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:42:14 2022] GET /compute/v2.1/servers/07a8c30d-1b9a-422f-83c3-be1fa6bffe05 => generated 1200 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:42:15.215860 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-44a8713b-eaee-42d6-b3c6-f65926836785 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:42:15.217084 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-44a8713b-eaee-42d6-b3c6-f65926836785 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] [instance: 07a8c30d-1b9a-422f-83c3-be1fa6bffe05] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:42:15.237871 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-44a8713b-eaee-42d6-b3c6-f65926836785 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:15.238961 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-44a8713b-eaee-42d6-b3c6-f65926836785 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:15.240626 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-44a8713b-eaee-42d6-b3c6-f65926836785 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:15.241383 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-44a8713b-eaee-42d6-b3c6-f65926836785 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:15.517450 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-44a8713b-eaee-42d6-b3c6-f65926836785 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5cbf8d443de4a9fb627ef316fbd033f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff4784f6ab3499b88cb38c81780b754', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:42:15.548816 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-44a8713b-eaee-42d6-b3c6-f65926836785 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] 10.222.0.30 "GET /compute/v2.1/servers/07a8c30d-1b9a-422f-83c3-be1fa6bffe05" status: 200 len: 1266 microversion: 2.1 time: 0.338178 Jun 16 18:42:15.551513 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 480/996] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:42:15 2022] GET /compute/v2.1/servers/07a8c30d-1b9a-422f-83c3-be1fa6bffe05 => generated 1266 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:42:16.579624 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-ea501203-ac97-4889-9598-e754be061eaa tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:42:16.580917 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-ea501203-ac97-4889-9598-e754be061eaa tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] [instance: 07a8c30d-1b9a-422f-83c3-be1fa6bffe05] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:42:16.592714 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-ea501203-ac97-4889-9598-e754be061eaa tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:16.593164 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-ea501203-ac97-4889-9598-e754be061eaa tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:16.594195 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-ea501203-ac97-4889-9598-e754be061eaa tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:16.594639 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-ea501203-ac97-4889-9598-e754be061eaa tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:16.839161 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [req-810a7f8d-64c2-4c64-bb92-132b1bc278f3 req-a6756595-c8e6-4903-ab2e-43ed0ec44a8b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "07a8c30d-1b9a-422f-83c3-be1fa6bffe05", "tag": "3795d114-2dd6-4ca8-8bb7-3dcaf8cde487"}]} {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:42:16.850718 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-ea501203-ac97-4889-9598-e754be061eaa tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5cbf8d443de4a9fb627ef316fbd033f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff4784f6ab3499b88cb38c81780b754', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:42:16.858113 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [req-810a7f8d-64c2-4c64-bb92-132b1bc278f3 req-a6756595-c8e6-4903-ab2e-43ed0ec44a8b service nova] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:16.859031 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [req-810a7f8d-64c2-4c64-bb92-132b1bc278f3 req-a6756595-c8e6-4903-ab2e-43ed0ec44a8b service nova] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:16.872014 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-ea501203-ac97-4889-9598-e754be061eaa tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] 10.222.0.30 "GET /compute/v2.1/servers/07a8c30d-1b9a-422f-83c3-be1fa6bffe05" status: 200 len: 1266 microversion: 2.1 time: 0.299206 Jun 16 18:42:16.873167 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.compute.server_external_events [req-810a7f8d-64c2-4c64-bb92-132b1bc278f3 req-a6756595-c8e6-4903-ab2e-43ed0ec44a8b service nova] Creating event network-changed:3795d114-2dd6-4ca8-8bb7-3dcaf8cde487 for instance 07a8c30d-1b9a-422f-83c3-be1fa6bffe05 on hv-cinder-81322 Jun 16 18:42:16.888844 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 517/997] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:42:16 2022] GET /compute/v2.1/servers/07a8c30d-1b9a-422f-83c3-be1fa6bffe05 => generated 1266 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:42:16.893334 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [req-810a7f8d-64c2-4c64-bb92-132b1bc278f3 req-a6756595-c8e6-4903-ab2e-43ed0ec44a8b service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065879 Jun 16 18:42:16.893982 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 481/998] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Jun 16 18:42:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:42:17.904849 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-e99e8084-d110-49d8-92a4-a02c0ef83d19 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:42:17.906028 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-e99e8084-d110-49d8-92a4-a02c0ef83d19 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] [instance: 07a8c30d-1b9a-422f-83c3-be1fa6bffe05] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:42:17.919642 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-e99e8084-d110-49d8-92a4-a02c0ef83d19 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:17.920504 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-e99e8084-d110-49d8-92a4-a02c0ef83d19 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:17.921885 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-e99e8084-d110-49d8-92a4-a02c0ef83d19 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:17.922682 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-e99e8084-d110-49d8-92a4-a02c0ef83d19 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:18.183601 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-e99e8084-d110-49d8-92a4-a02c0ef83d19 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5cbf8d443de4a9fb627ef316fbd033f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff4784f6ab3499b88cb38c81780b754', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:42:18.192110 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-e99e8084-d110-49d8-92a4-a02c0ef83d19 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] 10.222.0.30 "GET /compute/v2.1/servers/07a8c30d-1b9a-422f-83c3-be1fa6bffe05" status: 200 len: 1266 microversion: 2.1 time: 0.295824 Jun 16 18:42:18.192717 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 518/999] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:42:17 2022] GET /compute/v2.1/servers/07a8c30d-1b9a-422f-83c3-be1fa6bffe05 => generated 1266 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:42:19.212183 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-bd77da9a-b289-4a35-82f5-bfa48458cf09 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:42:19.212897 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-bd77da9a-b289-4a35-82f5-bfa48458cf09 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] [instance: 07a8c30d-1b9a-422f-83c3-be1fa6bffe05] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:42:19.220283 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-bd77da9a-b289-4a35-82f5-bfa48458cf09 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:19.221074 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-bd77da9a-b289-4a35-82f5-bfa48458cf09 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:19.222198 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-bd77da9a-b289-4a35-82f5-bfa48458cf09 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:19.222863 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-bd77da9a-b289-4a35-82f5-bfa48458cf09 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:19.380602 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-bd77da9a-b289-4a35-82f5-bfa48458cf09 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5cbf8d443de4a9fb627ef316fbd033f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff4784f6ab3499b88cb38c81780b754', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:42:19.389441 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-bd77da9a-b289-4a35-82f5-bfa48458cf09 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] 10.222.0.30 "GET /compute/v2.1/servers/07a8c30d-1b9a-422f-83c3-be1fa6bffe05" status: 200 len: 1266 microversion: 2.1 time: 0.182982 Jun 16 18:42:19.390048 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 482/1000] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:42:19 2022] GET /compute/v2.1/servers/07a8c30d-1b9a-422f-83c3-be1fa6bffe05 => generated 1266 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:42:20.407439 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-38e1b9b5-f448-435e-ac2b-b79c257163b1 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:42:20.408132 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-38e1b9b5-f448-435e-ac2b-b79c257163b1 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] [instance: 07a8c30d-1b9a-422f-83c3-be1fa6bffe05] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:42:20.415395 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-38e1b9b5-f448-435e-ac2b-b79c257163b1 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:20.415841 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-38e1b9b5-f448-435e-ac2b-b79c257163b1 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:20.416763 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-38e1b9b5-f448-435e-ac2b-b79c257163b1 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:20.417152 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-38e1b9b5-f448-435e-ac2b-b79c257163b1 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:20.630467 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-38e1b9b5-f448-435e-ac2b-b79c257163b1 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5cbf8d443de4a9fb627ef316fbd033f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff4784f6ab3499b88cb38c81780b754', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:42:20.639947 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-38e1b9b5-f448-435e-ac2b-b79c257163b1 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] 10.222.0.30 "GET /compute/v2.1/servers/07a8c30d-1b9a-422f-83c3-be1fa6bffe05" status: 200 len: 1266 microversion: 2.1 time: 0.236451 Jun 16 18:42:20.640814 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 519/1001] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:42:20 2022] GET /compute/v2.1/servers/07a8c30d-1b9a-422f-83c3-be1fa6bffe05 => generated 1266 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:42:21.658814 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-c2533bf2-83c8-4464-b0a1-b3f1f9f2c5f2 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:42:21.660406 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-c2533bf2-83c8-4464-b0a1-b3f1f9f2c5f2 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] [instance: 07a8c30d-1b9a-422f-83c3-be1fa6bffe05] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:42:21.668316 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-c2533bf2-83c8-4464-b0a1-b3f1f9f2c5f2 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:21.668896 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-c2533bf2-83c8-4464-b0a1-b3f1f9f2c5f2 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:21.669810 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-c2533bf2-83c8-4464-b0a1-b3f1f9f2c5f2 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:21.670344 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-c2533bf2-83c8-4464-b0a1-b3f1f9f2c5f2 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:21.831178 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-c2533bf2-83c8-4464-b0a1-b3f1f9f2c5f2 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5cbf8d443de4a9fb627ef316fbd033f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff4784f6ab3499b88cb38c81780b754', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:42:21.840104 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-c2533bf2-83c8-4464-b0a1-b3f1f9f2c5f2 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] 10.222.0.30 "GET /compute/v2.1/servers/07a8c30d-1b9a-422f-83c3-be1fa6bffe05" status: 200 len: 1266 microversion: 2.1 time: 0.185511 Jun 16 18:42:21.840714 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 483/1002] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:42:21 2022] GET /compute/v2.1/servers/07a8c30d-1b9a-422f-83c3-be1fa6bffe05 => generated 1266 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:42:22.857404 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-450ae36b-f7b4-49eb-bf60-6c79d9a70a2b tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:42:22.858096 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-450ae36b-f7b4-49eb-bf60-6c79d9a70a2b tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] [instance: 07a8c30d-1b9a-422f-83c3-be1fa6bffe05] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:42:22.860688 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG dbcounter [-] [117670] Writing DB stats nova_cell0:SELECT=2 {{(pid=117670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:42:22.861395 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG dbcounter [-] [117670] Writing DB stats nova_cell0:SELECT=6 {{(pid=117670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:42:22.868096 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-450ae36b-f7b4-49eb-bf60-6c79d9a70a2b tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:22.868557 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-450ae36b-f7b4-49eb-bf60-6c79d9a70a2b tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:22.869339 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-450ae36b-f7b4-49eb-bf60-6c79d9a70a2b tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:22.870417 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-450ae36b-f7b4-49eb-bf60-6c79d9a70a2b tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:23.027772 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-450ae36b-f7b4-49eb-bf60-6c79d9a70a2b tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5cbf8d443de4a9fb627ef316fbd033f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff4784f6ab3499b88cb38c81780b754', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:42:23.035819 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-450ae36b-f7b4-49eb-bf60-6c79d9a70a2b tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] 10.222.0.30 "GET /compute/v2.1/servers/07a8c30d-1b9a-422f-83c3-be1fa6bffe05" status: 200 len: 1266 microversion: 2.1 time: 0.182295 Jun 16 18:42:23.036448 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 520/1003] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:42:22 2022] GET /compute/v2.1/servers/07a8c30d-1b9a-422f-83c3-be1fa6bffe05 => generated 1266 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:42:24.055237 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-bd905ff1-7e3b-46ae-a248-9b54f5e8e7a4 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:42:24.056326 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-bd905ff1-7e3b-46ae-a248-9b54f5e8e7a4 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] [instance: 07a8c30d-1b9a-422f-83c3-be1fa6bffe05] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:42:24.060161 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG dbcounter [-] [117671] Writing DB stats nova_cell0:SELECT=2 {{(pid=117671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:42:24.068131 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-bd905ff1-7e3b-46ae-a248-9b54f5e8e7a4 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:24.068928 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-bd905ff1-7e3b-46ae-a248-9b54f5e8e7a4 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:24.070325 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-bd905ff1-7e3b-46ae-a248-9b54f5e8e7a4 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:24.071089 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-bd905ff1-7e3b-46ae-a248-9b54f5e8e7a4 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:24.263316 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-bd905ff1-7e3b-46ae-a248-9b54f5e8e7a4 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5cbf8d443de4a9fb627ef316fbd033f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff4784f6ab3499b88cb38c81780b754', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:42:24.277231 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-bd905ff1-7e3b-46ae-a248-9b54f5e8e7a4 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] 10.222.0.30 "GET /compute/v2.1/servers/07a8c30d-1b9a-422f-83c3-be1fa6bffe05" status: 200 len: 1266 microversion: 2.1 time: 0.226626 Jun 16 18:42:24.277831 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 484/1004] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:42:24 2022] GET /compute/v2.1/servers/07a8c30d-1b9a-422f-83c3-be1fa6bffe05 => generated 1266 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:42:25.297599 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-47b4fece-29ac-4029-ad24-6dff62828193 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:42:25.298816 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-47b4fece-29ac-4029-ad24-6dff62828193 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] [instance: 07a8c30d-1b9a-422f-83c3-be1fa6bffe05] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:42:25.311608 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-47b4fece-29ac-4029-ad24-6dff62828193 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:25.312602 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-47b4fece-29ac-4029-ad24-6dff62828193 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:25.314544 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-47b4fece-29ac-4029-ad24-6dff62828193 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:25.315546 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-47b4fece-29ac-4029-ad24-6dff62828193 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:25.543303 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-47b4fece-29ac-4029-ad24-6dff62828193 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5cbf8d443de4a9fb627ef316fbd033f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff4784f6ab3499b88cb38c81780b754', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:42:25.552994 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-47b4fece-29ac-4029-ad24-6dff62828193 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] 10.222.0.30 "GET /compute/v2.1/servers/07a8c30d-1b9a-422f-83c3-be1fa6bffe05" status: 200 len: 1266 microversion: 2.1 time: 0.261020 Jun 16 18:42:25.553602 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 521/1005] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:42:25 2022] GET /compute/v2.1/servers/07a8c30d-1b9a-422f-83c3-be1fa6bffe05 => generated 1266 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:42:26.397211 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [req-f9881f64-c638-49ca-8231-54310682e78b req-82ab12e4-58e7-47c2-9559-c3548b43299b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "07a8c30d-1b9a-422f-83c3-be1fa6bffe05", "name": "network-vif-plugged", "status": "completed", "tag": "3795d114-2dd6-4ca8-8bb7-3dcaf8cde487"}]} {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:42:26.407364 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [req-f9881f64-c638-49ca-8231-54310682e78b req-82ab12e4-58e7-47c2-9559-c3548b43299b service nova] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:26.408454 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [req-f9881f64-c638-49ca-8231-54310682e78b req-82ab12e4-58e7-47c2-9559-c3548b43299b service nova] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:26.424486 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.compute.server_external_events [req-f9881f64-c638-49ca-8231-54310682e78b req-82ab12e4-58e7-47c2-9559-c3548b43299b service nova] Creating event network-vif-plugged:3795d114-2dd6-4ca8-8bb7-3dcaf8cde487 for instance 07a8c30d-1b9a-422f-83c3-be1fa6bffe05 on hv-cinder-81322 Jun 16 18:42:26.431019 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [req-f9881f64-c638-49ca-8231-54310682e78b req-82ab12e4-58e7-47c2-9559-c3548b43299b service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037506 Jun 16 18:42:26.432025 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 485/1006] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Jun 16 18:42:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 18:42:26.572109 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-f985761e-fdb5-4079-909d-9b22d7476292 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:42:26.573009 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-f985761e-fdb5-4079-909d-9b22d7476292 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] [instance: 07a8c30d-1b9a-422f-83c3-be1fa6bffe05] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:42:26.580904 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-f985761e-fdb5-4079-909d-9b22d7476292 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:26.581481 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-f985761e-fdb5-4079-909d-9b22d7476292 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:26.582468 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-f985761e-fdb5-4079-909d-9b22d7476292 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:26.583136 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-f985761e-fdb5-4079-909d-9b22d7476292 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:26.825307 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-f985761e-fdb5-4079-909d-9b22d7476292 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5cbf8d443de4a9fb627ef316fbd033f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff4784f6ab3499b88cb38c81780b754', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:42:26.833436 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-f985761e-fdb5-4079-909d-9b22d7476292 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] 10.222.0.30 "GET /compute/v2.1/servers/07a8c30d-1b9a-422f-83c3-be1fa6bffe05" status: 200 len: 1266 microversion: 2.1 time: 0.265532 Jun 16 18:42:26.834196 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 522/1007] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:42:26 2022] GET /compute/v2.1/servers/07a8c30d-1b9a-422f-83c3-be1fa6bffe05 => generated 1266 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:42:27.852385 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-2cf208e7-6b6d-4a27-8b22-f2f030150ae6 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:42:27.853212 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-2cf208e7-6b6d-4a27-8b22-f2f030150ae6 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] [instance: 07a8c30d-1b9a-422f-83c3-be1fa6bffe05] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:42:27.860398 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-2cf208e7-6b6d-4a27-8b22-f2f030150ae6 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:27.860863 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-2cf208e7-6b6d-4a27-8b22-f2f030150ae6 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:27.861656 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-2cf208e7-6b6d-4a27-8b22-f2f030150ae6 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:27.862101 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-2cf208e7-6b6d-4a27-8b22-f2f030150ae6 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:28.011064 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-2cf208e7-6b6d-4a27-8b22-f2f030150ae6 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5cbf8d443de4a9fb627ef316fbd033f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff4784f6ab3499b88cb38c81780b754', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:42:28.023344 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-2cf208e7-6b6d-4a27-8b22-f2f030150ae6 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] 10.222.0.30 "GET /compute/v2.1/servers/07a8c30d-1b9a-422f-83c3-be1fa6bffe05" status: 200 len: 1454 microversion: 2.1 time: 0.175512 Jun 16 18:42:28.024311 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 486/1008] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:42:27 2022] GET /compute/v2.1/servers/07a8c30d-1b9a-422f-83c3-be1fa6bffe05 => generated 1454 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:42:28.048220 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-b8ca9e11-ab44-415f-8b96-cf73b2e065f9 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:42:28.049248 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-b8ca9e11-ab44-415f-8b96-cf73b2e065f9 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] [instance: 07a8c30d-1b9a-422f-83c3-be1fa6bffe05] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:42:28.057927 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-b8ca9e11-ab44-415f-8b96-cf73b2e065f9 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:28.058393 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-b8ca9e11-ab44-415f-8b96-cf73b2e065f9 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:28.059213 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-b8ca9e11-ab44-415f-8b96-cf73b2e065f9 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:28.059665 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-b8ca9e11-ab44-415f-8b96-cf73b2e065f9 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:28.219234 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-b8ca9e11-ab44-415f-8b96-cf73b2e065f9 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5cbf8d443de4a9fb627ef316fbd033f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff4784f6ab3499b88cb38c81780b754', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:42:28.228136 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-b8ca9e11-ab44-415f-8b96-cf73b2e065f9 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] 10.222.0.30 "GET /compute/v2.1/servers/07a8c30d-1b9a-422f-83c3-be1fa6bffe05" status: 200 len: 1454 microversion: 2.1 time: 0.184255 Jun 16 18:42:28.228850 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 523/1009] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:42:28 2022] GET /compute/v2.1/servers/07a8c30d-1b9a-422f-83c3-be1fa6bffe05 => generated 1454 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:42:30.546243 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [req-6a8e08db-3f4c-4a6e-a33b-b2bc2545cd1a req-b38d5dd0-1b10-4488-8be6-0af09d673685 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "07a8c30d-1b9a-422f-83c3-be1fa6bffe05", "tag": "3795d114-2dd6-4ca8-8bb7-3dcaf8cde487"}]} {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:42:30.555699 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [req-6a8e08db-3f4c-4a6e-a33b-b2bc2545cd1a req-b38d5dd0-1b10-4488-8be6-0af09d673685 service nova] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:42:30.556170 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [req-6a8e08db-3f4c-4a6e-a33b-b2bc2545cd1a req-b38d5dd0-1b10-4488-8be6-0af09d673685 service nova] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:42:30.570137 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.compute.server_external_events [req-6a8e08db-3f4c-4a6e-a33b-b2bc2545cd1a req-b38d5dd0-1b10-4488-8be6-0af09d673685 service nova] Creating event network-changed:3795d114-2dd6-4ca8-8bb7-3dcaf8cde487 for instance 07a8c30d-1b9a-422f-83c3-be1fa6bffe05 on hv-cinder-81322 Jun 16 18:42:30.576936 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [req-6a8e08db-3f4c-4a6e-a33b-b2bc2545cd1a req-b38d5dd0-1b10-4488-8be6-0af09d673685 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034056 Jun 16 18:42:30.577571 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 487/1010] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Jun 16 18:42:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:43:51.051609 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 16 18:43:51.052387 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: Thu Jun 16 18:43:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 16 18:44:09.687053 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR oslo.messaging._drivers.impl_rabbit [-] [8bfac49d-3f79-4f09-ac97-e62cc481eb2c] AMQP server on 10.222.0.30:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jun 16 18:44:09.687689 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG dbcounter [-] [117670] Writing DB stats nova_api:SELECT=42,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=117670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:44:09.689315 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG dbcounter [-] [117670] Writing DB stats nova_cell1:SELECT=72,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:44:09.693175 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-d069fc8e-f4f8-4f0f-8488-e6137e9acfb2 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1158491391", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1062823508", "security_groups": [{"name": "tempest-secgroup-smoke-1290455754"}], "block_device_mapping_v2": [{"uuid": "e3a3ec72-d7b3-4f39-bc5a-2a22aba25096", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "b0cbaebd-d55a-4d35-baec-5307687a93e6"}]}} {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:44:10.105751 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.network.neutron [None req-d069fc8e-f4f8-4f0f-8488-e6137e9acfb2 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] validate_networks() for [('b0cbaebd-d55a-4d35-baec-5307687a93e6', None, None, None, None, None)] {{(pid=117670) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 18:44:10.530165 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.virt.hardware [None req-d069fc8e-f4f8-4f0f-8488-e6137e9acfb2 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Flavor limits 0:0:0 {{(pid=117670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 18:44:10.530765 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.virt.hardware [None req-d069fc8e-f4f8-4f0f-8488-e6137e9acfb2 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Image limits 0:0:0 {{(pid=117670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 18:44:10.531410 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.virt.hardware [None req-d069fc8e-f4f8-4f0f-8488-e6137e9acfb2 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Flavor pref 0:0:0 {{(pid=117670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 18:44:10.531873 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.virt.hardware [None req-d069fc8e-f4f8-4f0f-8488-e6137e9acfb2 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Image pref 0:0:0 {{(pid=117670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 18:44:10.532412 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.virt.hardware [None req-d069fc8e-f4f8-4f0f-8488-e6137e9acfb2 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 18:44:10.542816 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-d069fc8e-f4f8-4f0f-8488-e6137e9acfb2 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:10.543264 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-d069fc8e-f4f8-4f0f-8488-e6137e9acfb2 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:10.544123 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-d069fc8e-f4f8-4f0f-8488-e6137e9acfb2 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:10.544563 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-d069fc8e-f4f8-4f0f-8488-e6137e9acfb2 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:10.564736 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.quota [None req-d069fc8e-f4f8-4f0f-8488-e6137e9acfb2 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Getting quotas for project dff4784f6ab3499b88cb38c81780b754. Resources: {'instances', 'ram', 'cores'} {{(pid=117670) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 18:44:10.569240 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.quota [None req-d069fc8e-f4f8-4f0f-8488-e6137e9acfb2 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Getting quotas for user e5cbf8d443de4a9fb627ef316fbd033f and project dff4784f6ab3499b88cb38c81780b754. Resources: {'instances', 'ram', 'cores'} {{(pid=117670) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 18:44:10.637680 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-d069fc8e-f4f8-4f0f-8488-e6137e9acfb2 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Going to run 1 instances... {{(pid=117670) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 18:44:10.639790 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-d069fc8e-f4f8-4f0f-8488-e6137e9acfb2 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] [instance: 018f27c2-c42a-4d5e-8353-0a67ecd1d96c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='e3a3ec72-d7b3-4f39-bc5a-2a22aba25096',volume_size=None,volume_type=None)] {{(pid=117670) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 18:44:10.701606 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO oslo.messaging._drivers.impl_rabbit [-] [8bfac49d-3f79-4f09-ac97-e62cc481eb2c] Reconnected to AMQP server on 10.222.0.30:5672 via [amqp] client with port 57818. Jun 16 18:44:10.806991 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-d069fc8e-f4f8-4f0f-8488-e6137e9acfb2 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.122292 Jun 16 18:44:10.816537 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 524/1011] 10.222.0.30 () {60 vars in 1146 bytes} [Thu Jun 16 18:44:09 2022] POST /compute/v2.1/servers => generated 406 bytes in 1125 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 18:44:10.828594 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-dd017f01-22a6-4ca1-b96b-63e040f132cd tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:44:10.830015 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-dd017f01-22a6-4ca1-b96b-63e040f132cd tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] [instance: 018f27c2-c42a-4d5e-8353-0a67ecd1d96c] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:44:10.833716 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG dbcounter [-] [117671] Writing DB stats nova_api:SELECT=26 {{(pid=117671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:44:10.834746 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG dbcounter [-] [117671] Writing DB stats nova_cell1:SELECT=50 {{(pid=117671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:44:11.094459 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-dd017f01-22a6-4ca1-b96b-63e040f132cd tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5cbf8d443de4a9fb627ef316fbd033f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff4784f6ab3499b88cb38c81780b754', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:44:11.105567 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-dd017f01-22a6-4ca1-b96b-63e040f132cd tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] 10.222.0.30 "GET /compute/v2.1/servers/018f27c2-c42a-4d5e-8353-0a67ecd1d96c" status: 200 len: 1095 microversion: 2.1 time: 0.286435 Jun 16 18:44:11.106546 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 488/1012] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:44:10 2022] GET /compute/v2.1/servers/018f27c2-c42a-4d5e-8353-0a67ecd1d96c => generated 1095 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:44:12.133779 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-d0812b11-2a19-4657-8e0b-38a1c1be207b tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:44:12.135541 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-d0812b11-2a19-4657-8e0b-38a1c1be207b tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] [instance: 018f27c2-c42a-4d5e-8353-0a67ecd1d96c] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:44:12.150760 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-d0812b11-2a19-4657-8e0b-38a1c1be207b tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:12.152115 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-d0812b11-2a19-4657-8e0b-38a1c1be207b tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:12.153961 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-d0812b11-2a19-4657-8e0b-38a1c1be207b tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:12.154913 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-d0812b11-2a19-4657-8e0b-38a1c1be207b tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:12.279865 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-d0812b11-2a19-4657-8e0b-38a1c1be207b tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5cbf8d443de4a9fb627ef316fbd033f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff4784f6ab3499b88cb38c81780b754', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:44:12.294578 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-d0812b11-2a19-4657-8e0b-38a1c1be207b tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] 10.222.0.30 "GET /compute/v2.1/servers/018f27c2-c42a-4d5e-8353-0a67ecd1d96c" status: 200 len: 1211 microversion: 2.1 time: 0.170021 Jun 16 18:44:12.295667 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 525/1013] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:44:12 2022] GET /compute/v2.1/servers/018f27c2-c42a-4d5e-8353-0a67ecd1d96c => generated 1211 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:44:13.314348 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-3241170a-3a77-4452-958b-6718e20cf665 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:44:13.315260 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-3241170a-3a77-4452-958b-6718e20cf665 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] [instance: 018f27c2-c42a-4d5e-8353-0a67ecd1d96c] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:44:13.323366 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-3241170a-3a77-4452-958b-6718e20cf665 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:13.323919 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-3241170a-3a77-4452-958b-6718e20cf665 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:13.324772 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-3241170a-3a77-4452-958b-6718e20cf665 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:13.325214 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-3241170a-3a77-4452-958b-6718e20cf665 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:13.496205 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-3241170a-3a77-4452-958b-6718e20cf665 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5cbf8d443de4a9fb627ef316fbd033f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff4784f6ab3499b88cb38c81780b754', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:44:13.512336 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-3241170a-3a77-4452-958b-6718e20cf665 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] 10.222.0.30 "GET /compute/v2.1/servers/018f27c2-c42a-4d5e-8353-0a67ecd1d96c" status: 200 len: 1267 microversion: 2.1 time: 0.202025 Jun 16 18:44:13.514001 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 489/1014] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:44:13 2022] GET /compute/v2.1/servers/018f27c2-c42a-4d5e-8353-0a67ecd1d96c => generated 1267 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:44:13.898394 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [req-1bba6c5e-935a-43e8-aa2c-10cbb13f48d7 req-6b63edb7-10c9-4d59-b474-f45599576917 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "018f27c2-c42a-4d5e-8353-0a67ecd1d96c", "tag": "896bef9c-c96e-46af-a0be-8c88ddb33da5"}]} {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:44:13.927376 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [req-1bba6c5e-935a-43e8-aa2c-10cbb13f48d7 req-6b63edb7-10c9-4d59-b474-f45599576917 service nova] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:13.928203 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [req-1bba6c5e-935a-43e8-aa2c-10cbb13f48d7 req-6b63edb7-10c9-4d59-b474-f45599576917 service nova] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:13.956186 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.compute.server_external_events [req-1bba6c5e-935a-43e8-aa2c-10cbb13f48d7 req-6b63edb7-10c9-4d59-b474-f45599576917 service nova] Creating event network-changed:896bef9c-c96e-46af-a0be-8c88ddb33da5 for instance 018f27c2-c42a-4d5e-8353-0a67ecd1d96c on hv-cinder-81322 Jun 16 18:44:13.965920 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [req-1bba6c5e-935a-43e8-aa2c-10cbb13f48d7 req-6b63edb7-10c9-4d59-b474-f45599576917 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092612 Jun 16 18:44:13.967688 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 526/1015] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Jun 16 18:44:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:44:14.531258 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-ce148d79-cf45-471b-b9ae-38e0766f03bc tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:44:14.531995 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-ce148d79-cf45-471b-b9ae-38e0766f03bc tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] [instance: 018f27c2-c42a-4d5e-8353-0a67ecd1d96c] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:44:14.540438 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-ce148d79-cf45-471b-b9ae-38e0766f03bc tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:14.540935 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-ce148d79-cf45-471b-b9ae-38e0766f03bc tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:14.541783 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-ce148d79-cf45-471b-b9ae-38e0766f03bc tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:14.542229 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-ce148d79-cf45-471b-b9ae-38e0766f03bc tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:14.712330 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-ce148d79-cf45-471b-b9ae-38e0766f03bc tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5cbf8d443de4a9fb627ef316fbd033f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff4784f6ab3499b88cb38c81780b754', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:44:14.725420 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-ce148d79-cf45-471b-b9ae-38e0766f03bc tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] 10.222.0.30 "GET /compute/v2.1/servers/018f27c2-c42a-4d5e-8353-0a67ecd1d96c" status: 200 len: 1267 microversion: 2.1 time: 0.197940 Jun 16 18:44:14.726476 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 490/1016] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:44:14 2022] GET /compute/v2.1/servers/018f27c2-c42a-4d5e-8353-0a67ecd1d96c => generated 1267 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:44:15.751255 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-aa4497e7-401e-4bbd-a577-8bb72e545649 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:44:15.752413 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-aa4497e7-401e-4bbd-a577-8bb72e545649 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] [instance: 018f27c2-c42a-4d5e-8353-0a67ecd1d96c] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:44:15.760819 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-aa4497e7-401e-4bbd-a577-8bb72e545649 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:15.761446 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-aa4497e7-401e-4bbd-a577-8bb72e545649 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:15.762294 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-aa4497e7-401e-4bbd-a577-8bb72e545649 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:15.762844 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-aa4497e7-401e-4bbd-a577-8bb72e545649 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:15.920759 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-aa4497e7-401e-4bbd-a577-8bb72e545649 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5cbf8d443de4a9fb627ef316fbd033f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff4784f6ab3499b88cb38c81780b754', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:44:15.930999 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-aa4497e7-401e-4bbd-a577-8bb72e545649 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] 10.222.0.30 "GET /compute/v2.1/servers/018f27c2-c42a-4d5e-8353-0a67ecd1d96c" status: 200 len: 1267 microversion: 2.1 time: 0.186111 Jun 16 18:44:15.931846 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 527/1017] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:44:15 2022] GET /compute/v2.1/servers/018f27c2-c42a-4d5e-8353-0a67ecd1d96c => generated 1267 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:44:16.949690 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-51a65c0b-d382-490f-b43f-f3fbf0c04311 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:44:16.950361 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-51a65c0b-d382-490f-b43f-f3fbf0c04311 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] [instance: 018f27c2-c42a-4d5e-8353-0a67ecd1d96c] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:44:16.957931 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-51a65c0b-d382-490f-b43f-f3fbf0c04311 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:16.958389 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-51a65c0b-d382-490f-b43f-f3fbf0c04311 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:16.959205 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-51a65c0b-d382-490f-b43f-f3fbf0c04311 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:16.959643 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-51a65c0b-d382-490f-b43f-f3fbf0c04311 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:17.113730 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-51a65c0b-d382-490f-b43f-f3fbf0c04311 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5cbf8d443de4a9fb627ef316fbd033f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff4784f6ab3499b88cb38c81780b754', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:44:17.122777 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-51a65c0b-d382-490f-b43f-f3fbf0c04311 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] 10.222.0.30 "GET /compute/v2.1/servers/018f27c2-c42a-4d5e-8353-0a67ecd1d96c" status: 200 len: 1267 microversion: 2.1 time: 0.177264 Jun 16 18:44:17.123375 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 491/1018] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:44:16 2022] GET /compute/v2.1/servers/018f27c2-c42a-4d5e-8353-0a67ecd1d96c => generated 1267 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:44:18.142139 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-a517d7ea-b15c-45b4-9a0d-b1583effee13 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:44:18.142794 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-a517d7ea-b15c-45b4-9a0d-b1583effee13 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] [instance: 018f27c2-c42a-4d5e-8353-0a67ecd1d96c] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:44:18.150683 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-a517d7ea-b15c-45b4-9a0d-b1583effee13 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:18.151138 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-a517d7ea-b15c-45b4-9a0d-b1583effee13 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:18.151933 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-a517d7ea-b15c-45b4-9a0d-b1583effee13 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:18.152401 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-a517d7ea-b15c-45b4-9a0d-b1583effee13 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:18.302779 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-a517d7ea-b15c-45b4-9a0d-b1583effee13 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5cbf8d443de4a9fb627ef316fbd033f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff4784f6ab3499b88cb38c81780b754', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:44:18.310907 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-a517d7ea-b15c-45b4-9a0d-b1583effee13 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] 10.222.0.30 "GET /compute/v2.1/servers/018f27c2-c42a-4d5e-8353-0a67ecd1d96c" status: 200 len: 1267 microversion: 2.1 time: 0.173217 Jun 16 18:44:18.311505 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 528/1019] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:44:18 2022] GET /compute/v2.1/servers/018f27c2-c42a-4d5e-8353-0a67ecd1d96c => generated 1267 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:44:19.332541 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-74a405bc-fabe-465c-83bf-e21c2522f4f3 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:44:19.333624 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-74a405bc-fabe-465c-83bf-e21c2522f4f3 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] [instance: 018f27c2-c42a-4d5e-8353-0a67ecd1d96c] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:44:19.343006 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-74a405bc-fabe-465c-83bf-e21c2522f4f3 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:19.343593 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-74a405bc-fabe-465c-83bf-e21c2522f4f3 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:19.344862 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-74a405bc-fabe-465c-83bf-e21c2522f4f3 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:19.345226 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-74a405bc-fabe-465c-83bf-e21c2522f4f3 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:19.504722 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-74a405bc-fabe-465c-83bf-e21c2522f4f3 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5cbf8d443de4a9fb627ef316fbd033f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff4784f6ab3499b88cb38c81780b754', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:44:19.517294 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-74a405bc-fabe-465c-83bf-e21c2522f4f3 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] 10.222.0.30 "GET /compute/v2.1/servers/018f27c2-c42a-4d5e-8353-0a67ecd1d96c" status: 200 len: 1267 microversion: 2.1 time: 0.191824 Jun 16 18:44:19.518185 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 492/1020] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:44:19 2022] GET /compute/v2.1/servers/018f27c2-c42a-4d5e-8353-0a67ecd1d96c => generated 1267 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:44:20.540651 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-24071c59-822d-4cb1-a340-81a5d4f1a152 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:44:20.541763 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-24071c59-822d-4cb1-a340-81a5d4f1a152 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] [instance: 018f27c2-c42a-4d5e-8353-0a67ecd1d96c] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:44:20.551029 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-24071c59-822d-4cb1-a340-81a5d4f1a152 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:20.551541 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-24071c59-822d-4cb1-a340-81a5d4f1a152 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:20.552465 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-24071c59-822d-4cb1-a340-81a5d4f1a152 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:20.552977 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-24071c59-822d-4cb1-a340-81a5d4f1a152 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:20.553630 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG dbcounter [-] [117670] Writing DB stats nova_cell0:SELECT=2 {{(pid=117670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:44:20.577390 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG dbcounter [-] [117670] Writing DB stats nova_cell0:SELECT=6 {{(pid=117670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:44:21.042925 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-24071c59-822d-4cb1-a340-81a5d4f1a152 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5cbf8d443de4a9fb627ef316fbd033f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff4784f6ab3499b88cb38c81780b754', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:44:21.052191 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-24071c59-822d-4cb1-a340-81a5d4f1a152 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] 10.222.0.30 "GET /compute/v2.1/servers/018f27c2-c42a-4d5e-8353-0a67ecd1d96c" status: 200 len: 1267 microversion: 2.1 time: 0.519029 Jun 16 18:44:21.052782 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 529/1021] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:44:20 2022] GET /compute/v2.1/servers/018f27c2-c42a-4d5e-8353-0a67ecd1d96c => generated 1267 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:44:22.070338 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-a5b6b923-6d84-493b-9aa2-628a020f594e tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:44:22.071026 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-a5b6b923-6d84-493b-9aa2-628a020f594e tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] [instance: 018f27c2-c42a-4d5e-8353-0a67ecd1d96c] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:44:22.074330 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG dbcounter [-] [117671] Writing DB stats nova_cell0:SELECT=2 {{(pid=117671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:44:22.080395 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-a5b6b923-6d84-493b-9aa2-628a020f594e tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:22.080853 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-a5b6b923-6d84-493b-9aa2-628a020f594e tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:22.081651 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-a5b6b923-6d84-493b-9aa2-628a020f594e tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:22.082105 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-a5b6b923-6d84-493b-9aa2-628a020f594e tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:22.232601 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-a5b6b923-6d84-493b-9aa2-628a020f594e tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5cbf8d443de4a9fb627ef316fbd033f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff4784f6ab3499b88cb38c81780b754', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:44:22.242703 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-a5b6b923-6d84-493b-9aa2-628a020f594e tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] 10.222.0.30 "GET /compute/v2.1/servers/018f27c2-c42a-4d5e-8353-0a67ecd1d96c" status: 200 len: 1267 microversion: 2.1 time: 0.176290 Jun 16 18:44:22.243598 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 493/1022] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:44:22 2022] GET /compute/v2.1/servers/018f27c2-c42a-4d5e-8353-0a67ecd1d96c => generated 1267 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:44:23.262532 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-93d3a014-4a63-4a05-804d-009bc0ee9e9b tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:44:23.263565 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-93d3a014-4a63-4a05-804d-009bc0ee9e9b tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] [instance: 018f27c2-c42a-4d5e-8353-0a67ecd1d96c] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:44:23.275517 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-93d3a014-4a63-4a05-804d-009bc0ee9e9b tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:23.276304 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-93d3a014-4a63-4a05-804d-009bc0ee9e9b tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:23.277685 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-93d3a014-4a63-4a05-804d-009bc0ee9e9b tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:23.278466 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-93d3a014-4a63-4a05-804d-009bc0ee9e9b tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:23.482875 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-93d3a014-4a63-4a05-804d-009bc0ee9e9b tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5cbf8d443de4a9fb627ef316fbd033f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff4784f6ab3499b88cb38c81780b754', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:44:23.497601 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-93d3a014-4a63-4a05-804d-009bc0ee9e9b tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] 10.222.0.30 "GET /compute/v2.1/servers/018f27c2-c42a-4d5e-8353-0a67ecd1d96c" status: 200 len: 1267 microversion: 2.1 time: 0.240510 Jun 16 18:44:23.498773 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 530/1023] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:44:23 2022] GET /compute/v2.1/servers/018f27c2-c42a-4d5e-8353-0a67ecd1d96c => generated 1267 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:44:24.529089 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-68e89110-a724-40d4-bb73-34662f0d83fb tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:44:24.530027 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-68e89110-a724-40d4-bb73-34662f0d83fb tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] [instance: 018f27c2-c42a-4d5e-8353-0a67ecd1d96c] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:44:24.537862 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-68e89110-a724-40d4-bb73-34662f0d83fb tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:24.538340 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-68e89110-a724-40d4-bb73-34662f0d83fb tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:24.539257 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-68e89110-a724-40d4-bb73-34662f0d83fb tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:24.539703 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-68e89110-a724-40d4-bb73-34662f0d83fb tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:24.705750 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-68e89110-a724-40d4-bb73-34662f0d83fb tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5cbf8d443de4a9fb627ef316fbd033f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff4784f6ab3499b88cb38c81780b754', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:44:24.720561 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-68e89110-a724-40d4-bb73-34662f0d83fb tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] 10.222.0.30 "GET /compute/v2.1/servers/018f27c2-c42a-4d5e-8353-0a67ecd1d96c" status: 200 len: 1267 microversion: 2.1 time: 0.195079 Jun 16 18:44:24.721757 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 494/1024] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:44:24 2022] GET /compute/v2.1/servers/018f27c2-c42a-4d5e-8353-0a67ecd1d96c => generated 1267 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:44:24.856463 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [req-eefc8485-7e20-43b3-aa45-bdbb7d1ba967 req-c9e81e7c-cd0b-4e55-b485-f905abecfcb4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "018f27c2-c42a-4d5e-8353-0a67ecd1d96c", "name": "network-vif-plugged", "status": "completed", "tag": "896bef9c-c96e-46af-a0be-8c88ddb33da5"}]} {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:44:24.866075 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [req-eefc8485-7e20-43b3-aa45-bdbb7d1ba967 req-c9e81e7c-cd0b-4e55-b485-f905abecfcb4 service nova] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:24.866712 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [req-eefc8485-7e20-43b3-aa45-bdbb7d1ba967 req-c9e81e7c-cd0b-4e55-b485-f905abecfcb4 service nova] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:24.883552 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.compute.server_external_events [req-eefc8485-7e20-43b3-aa45-bdbb7d1ba967 req-c9e81e7c-cd0b-4e55-b485-f905abecfcb4 service nova] Creating event network-vif-plugged:896bef9c-c96e-46af-a0be-8c88ddb33da5 for instance 018f27c2-c42a-4d5e-8353-0a67ecd1d96c on hv-cinder-81322 Jun 16 18:44:24.889326 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [req-eefc8485-7e20-43b3-aa45-bdbb7d1ba967 req-c9e81e7c-cd0b-4e55-b485-f905abecfcb4 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036580 Jun 16 18:44:24.889954 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 531/1025] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Jun 16 18:44:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:44:25.748931 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-8bc82fa8-1e78-4da3-bfae-ca7b7ce4a850 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:44:25.749570 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-8bc82fa8-1e78-4da3-bfae-ca7b7ce4a850 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] [instance: 018f27c2-c42a-4d5e-8353-0a67ecd1d96c] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:44:25.756960 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-8bc82fa8-1e78-4da3-bfae-ca7b7ce4a850 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:25.757747 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-8bc82fa8-1e78-4da3-bfae-ca7b7ce4a850 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:25.759059 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-8bc82fa8-1e78-4da3-bfae-ca7b7ce4a850 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:25.759507 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-8bc82fa8-1e78-4da3-bfae-ca7b7ce4a850 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:25.918480 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-8bc82fa8-1e78-4da3-bfae-ca7b7ce4a850 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5cbf8d443de4a9fb627ef316fbd033f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff4784f6ab3499b88cb38c81780b754', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:44:25.926855 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-8bc82fa8-1e78-4da3-bfae-ca7b7ce4a850 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] 10.222.0.30 "GET /compute/v2.1/servers/018f27c2-c42a-4d5e-8353-0a67ecd1d96c" status: 200 len: 1267 microversion: 2.1 time: 0.181748 Jun 16 18:44:25.927443 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 495/1026] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:44:25 2022] GET /compute/v2.1/servers/018f27c2-c42a-4d5e-8353-0a67ecd1d96c => generated 1267 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:44:26.955073 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-bd1c9bb8-77e6-4029-909c-e53c83d8eaf3 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:44:26.955791 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-bd1c9bb8-77e6-4029-909c-e53c83d8eaf3 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] [instance: 018f27c2-c42a-4d5e-8353-0a67ecd1d96c] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:44:26.963707 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-bd1c9bb8-77e6-4029-909c-e53c83d8eaf3 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:26.964240 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-bd1c9bb8-77e6-4029-909c-e53c83d8eaf3 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:26.965066 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-bd1c9bb8-77e6-4029-909c-e53c83d8eaf3 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:26.965510 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-bd1c9bb8-77e6-4029-909c-e53c83d8eaf3 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:27.129318 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-bd1c9bb8-77e6-4029-909c-e53c83d8eaf3 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5cbf8d443de4a9fb627ef316fbd033f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff4784f6ab3499b88cb38c81780b754', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:44:27.138881 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-bd1c9bb8-77e6-4029-909c-e53c83d8eaf3 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] 10.222.0.30 "GET /compute/v2.1/servers/018f27c2-c42a-4d5e-8353-0a67ecd1d96c" status: 200 len: 1454 microversion: 2.1 time: 0.188562 Jun 16 18:44:27.139506 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 532/1027] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:44:26 2022] GET /compute/v2.1/servers/018f27c2-c42a-4d5e-8353-0a67ecd1d96c => generated 1454 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:44:27.158137 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-a19cb959-5029-4861-94cb-c30d176b4845 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:44:27.158821 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-a19cb959-5029-4861-94cb-c30d176b4845 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] [instance: 018f27c2-c42a-4d5e-8353-0a67ecd1d96c] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:44:27.167119 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-a19cb959-5029-4861-94cb-c30d176b4845 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:27.167573 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-a19cb959-5029-4861-94cb-c30d176b4845 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:27.168395 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-a19cb959-5029-4861-94cb-c30d176b4845 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:27.168837 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-a19cb959-5029-4861-94cb-c30d176b4845 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:27.327642 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-a19cb959-5029-4861-94cb-c30d176b4845 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5cbf8d443de4a9fb627ef316fbd033f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff4784f6ab3499b88cb38c81780b754', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:44:27.336452 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-a19cb959-5029-4861-94cb-c30d176b4845 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] 10.222.0.30 "GET /compute/v2.1/servers/018f27c2-c42a-4d5e-8353-0a67ecd1d96c" status: 200 len: 1454 microversion: 2.1 time: 0.181885 Jun 16 18:44:27.337055 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 496/1028] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:44:27 2022] GET /compute/v2.1/servers/018f27c2-c42a-4d5e-8353-0a67ecd1d96c => generated 1454 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:44:29.415975 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [req-0d0aca25-b4a0-4100-a6d3-0ac8e02217aa req-ee46b1d6-2aec-4321-8902-0672f637e160 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "018f27c2-c42a-4d5e-8353-0a67ecd1d96c", "tag": "896bef9c-c96e-46af-a0be-8c88ddb33da5"}]} {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:44:29.427666 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [req-0d0aca25-b4a0-4100-a6d3-0ac8e02217aa req-ee46b1d6-2aec-4321-8902-0672f637e160 service nova] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:44:29.428380 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [req-0d0aca25-b4a0-4100-a6d3-0ac8e02217aa req-ee46b1d6-2aec-4321-8902-0672f637e160 service nova] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:44:29.442365 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.compute.server_external_events [req-0d0aca25-b4a0-4100-a6d3-0ac8e02217aa req-ee46b1d6-2aec-4321-8902-0672f637e160 service nova] Creating event network-changed:896bef9c-c96e-46af-a0be-8c88ddb33da5 for instance 018f27c2-c42a-4d5e-8353-0a67ecd1d96c on hv-cinder-81322 Jun 16 18:44:29.449839 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [req-0d0aca25-b4a0-4100-a6d3-0ac8e02217aa req-ee46b1d6-2aec-4321-8902-0672f637e160 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038712 Jun 16 18:44:29.450779 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 533/1029] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Jun 16 18:44:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 18:45:20.877025 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 16 18:45:20.877687 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: Thu Jun 16 18:45:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 16 18:45:25.628294 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 16 18:45:25.628976 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: Thu Jun 16 18:45:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 16 18:46:00.264931 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG dbcounter [-] [117671] Writing DB stats nova_api:SELECT=20 {{(pid=117671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:46:00.267378 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG dbcounter [-] [117671] Writing DB stats nova_cell1:SELECT=48 {{(pid=117671) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:46:00.271929 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG dbcounter [-] [117670] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=117670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:46:00.276685 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-7d23eae7-6158-4650-a9c9-9f05e90c59fe tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:46:00.277203 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-7d23eae7-6158-4650-a9c9-9f05e90c59fe tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] [instance: 018f27c2-c42a-4d5e-8353-0a67ecd1d96c] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:46:00.278527 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG dbcounter [-] [117670] Writing DB stats nova_cell1:SELECT=44 {{(pid=117670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:46:00.285041 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-7d23eae7-6158-4650-a9c9-9f05e90c59fe tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:46:00.285492 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-7d23eae7-6158-4650-a9c9-9f05e90c59fe tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:46:00.287129 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-7d23eae7-6158-4650-a9c9-9f05e90c59fe tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:46:00.288425 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-7d23eae7-6158-4650-a9c9-9f05e90c59fe tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:46:00.322953 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-7d23eae7-6158-4650-a9c9-9f05e90c59fe tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] [instance: 018f27c2-c42a-4d5e-8353-0a67ecd1d96c] Going to try to terminate instance {{(pid=117671) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 18:46:00.424569 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [req-d2b02ac8-01ac-4bf2-8f3d-95169bdac495 req-26af2c43-b509-475e-b215-2348f12a5f37 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "018f27c2-c42a-4d5e-8353-0a67ecd1d96c", "tag": "896bef9c-c96e-46af-a0be-8c88ddb33da5"}]} {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:46:00.426341 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-7d23eae7-6158-4650-a9c9-9f05e90c59fe tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] 10.222.0.30 "DELETE /compute/v2.1/servers/018f27c2-c42a-4d5e-8353-0a67ecd1d96c" status: 204 len: 0 microversion: 2.1 time: 0.163335 Jun 16 18:46:00.431593 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 497/1030] 10.222.0.30 () {58 vars in 1238 bytes} [Thu Jun 16 18:46:00 2022] DELETE /compute/v2.1/servers/018f27c2-c42a-4d5e-8353-0a67ecd1d96c => generated 0 bytes in 166 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 18:46:00.439018 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-ed1602f9-ee56-4b1d-8f3e-f0b8f901a1a5 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:46:00.439762 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-ed1602f9-ee56-4b1d-8f3e-f0b8f901a1a5 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] [instance: 018f27c2-c42a-4d5e-8353-0a67ecd1d96c] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:46:00.443770 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [req-d2b02ac8-01ac-4bf2-8f3d-95169bdac495 req-26af2c43-b509-475e-b215-2348f12a5f37 service nova] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:46:00.445328 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [req-d2b02ac8-01ac-4bf2-8f3d-95169bdac495 req-26af2c43-b509-475e-b215-2348f12a5f37 service nova] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:46:00.447478 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-ed1602f9-ee56-4b1d-8f3e-f0b8f901a1a5 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:46:00.448116 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-ed1602f9-ee56-4b1d-8f3e-f0b8f901a1a5 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:46:00.449168 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-ed1602f9-ee56-4b1d-8f3e-f0b8f901a1a5 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:46:00.449627 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-ed1602f9-ee56-4b1d-8f3e-f0b8f901a1a5 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:46:00.471049 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.compute.server_external_events [req-d2b02ac8-01ac-4bf2-8f3d-95169bdac495 req-26af2c43-b509-475e-b215-2348f12a5f37 service nova] Creating event network-changed:896bef9c-c96e-46af-a0be-8c88ddb33da5 for instance 018f27c2-c42a-4d5e-8353-0a67ecd1d96c on hv-cinder-81322 Jun 16 18:46:00.483659 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [req-d2b02ac8-01ac-4bf2-8f3d-95169bdac495 req-26af2c43-b509-475e-b215-2348f12a5f37 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.214324 Jun 16 18:46:00.484968 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 534/1031] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Jun 16 18:46:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:46:00.680335 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-ed1602f9-ee56-4b1d-8f3e-f0b8f901a1a5 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5cbf8d443de4a9fb627ef316fbd033f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff4784f6ab3499b88cb38c81780b754', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:46:00.695220 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-ed1602f9-ee56-4b1d-8f3e-f0b8f901a1a5 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] 10.222.0.30 "GET /compute/v2.1/servers/018f27c2-c42a-4d5e-8353-0a67ecd1d96c" status: 200 len: 1579 microversion: 2.1 time: 0.261620 Jun 16 18:46:00.696489 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 498/1032] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:46:00 2022] GET /compute/v2.1/servers/018f27c2-c42a-4d5e-8353-0a67ecd1d96c => generated 1579 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:46:01.729738 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-282ddd60-f6b4-42d2-bf1e-035a93a6c8a8 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:46:01.730875 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-282ddd60-f6b4-42d2-bf1e-035a93a6c8a8 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] [instance: 018f27c2-c42a-4d5e-8353-0a67ecd1d96c] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:46:01.744826 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-282ddd60-f6b4-42d2-bf1e-035a93a6c8a8 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:46:01.745663 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-282ddd60-f6b4-42d2-bf1e-035a93a6c8a8 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:46:01.747135 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-282ddd60-f6b4-42d2-bf1e-035a93a6c8a8 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:46:01.748244 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-282ddd60-f6b4-42d2-bf1e-035a93a6c8a8 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:46:01.994831 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-282ddd60-f6b4-42d2-bf1e-035a93a6c8a8 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5cbf8d443de4a9fb627ef316fbd033f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff4784f6ab3499b88cb38c81780b754', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:46:02.013358 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-282ddd60-f6b4-42d2-bf1e-035a93a6c8a8 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] 10.222.0.30 "GET /compute/v2.1/servers/018f27c2-c42a-4d5e-8353-0a67ecd1d96c" status: 200 len: 1579 microversion: 2.1 time: 0.290643 Jun 16 18:46:02.013738 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 535/1033] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:46:01 2022] GET /compute/v2.1/servers/018f27c2-c42a-4d5e-8353-0a67ecd1d96c => generated 1579 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:46:02.941324 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [req-8c39a0b8-8759-4e8b-afd6-42f96da3dac4 req-062e1b66-fc1f-40f5-8531-828ccfd0b74b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "018f27c2-c42a-4d5e-8353-0a67ecd1d96c", "name": "network-vif-deleted", "tag": "896bef9c-c96e-46af-a0be-8c88ddb33da5"}]} {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:46:02.953113 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [req-8c39a0b8-8759-4e8b-afd6-42f96da3dac4 req-062e1b66-fc1f-40f5-8531-828ccfd0b74b service nova] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:46:02.953565 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [req-8c39a0b8-8759-4e8b-afd6-42f96da3dac4 req-062e1b66-fc1f-40f5-8531-828ccfd0b74b service nova] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:46:02.971906 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.compute.server_external_events [req-8c39a0b8-8759-4e8b-afd6-42f96da3dac4 req-062e1b66-fc1f-40f5-8531-828ccfd0b74b service nova] Creating event network-vif-deleted:896bef9c-c96e-46af-a0be-8c88ddb33da5 for instance 018f27c2-c42a-4d5e-8353-0a67ecd1d96c on hv-cinder-81322 Jun 16 18:46:02.978060 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [req-8c39a0b8-8759-4e8b-afd6-42f96da3dac4 req-062e1b66-fc1f-40f5-8531-828ccfd0b74b service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.152820 Jun 16 18:46:02.978896 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 499/1034] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Jun 16 18:46:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:46:03.043456 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-a0ea5e5e-c231-473f-b586-caeac5c835d7 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:46:03.044486 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-a0ea5e5e-c231-473f-b586-caeac5c835d7 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] [instance: 018f27c2-c42a-4d5e-8353-0a67ecd1d96c] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:46:03.056625 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-a0ea5e5e-c231-473f-b586-caeac5c835d7 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:46:03.057348 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-a0ea5e5e-c231-473f-b586-caeac5c835d7 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:46:03.058735 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-a0ea5e5e-c231-473f-b586-caeac5c835d7 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:46:03.059510 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-a0ea5e5e-c231-473f-b586-caeac5c835d7 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:46:03.183762 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-a0ea5e5e-c231-473f-b586-caeac5c835d7 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5cbf8d443de4a9fb627ef316fbd033f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff4784f6ab3499b88cb38c81780b754', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:46:03.198506 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-a0ea5e5e-c231-473f-b586-caeac5c835d7 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] 10.222.0.30 "GET /compute/v2.1/servers/018f27c2-c42a-4d5e-8353-0a67ecd1d96c" status: 200 len: 1226 microversion: 2.1 time: 0.161260 Jun 16 18:46:03.199401 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 536/1035] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:46:03 2022] GET /compute/v2.1/servers/018f27c2-c42a-4d5e-8353-0a67ecd1d96c => generated 1226 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:46:04.227748 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-5abdc4d6-aba8-44e1-8053-ec3218304e48 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:46:04.228597 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-5abdc4d6-aba8-44e1-8053-ec3218304e48 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] [instance: 018f27c2-c42a-4d5e-8353-0a67ecd1d96c] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:46:04.235553 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-5abdc4d6-aba8-44e1-8053-ec3218304e48 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:46:04.236010 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-5abdc4d6-aba8-44e1-8053-ec3218304e48 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:46:04.236851 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-5abdc4d6-aba8-44e1-8053-ec3218304e48 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:46:04.237311 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-5abdc4d6-aba8-44e1-8053-ec3218304e48 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:46:04.253124 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.wsgi [None req-5abdc4d6-aba8-44e1-8053-ec3218304e48 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] HTTP exception thrown: Instance 018f27c2-c42a-4d5e-8353-0a67ecd1d96c could not be found. Jun 16 18:46:04.254988 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-5abdc4d6-aba8-44e1-8053-ec3218304e48 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Request method failure captured: Jun 16 18:46:04.254988 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: request: GET /compute/v2.1/servers/018f27c2-c42a-4d5e-8353-0a67ecd1d96c HTTP/1.1 Jun 16 18:46:04.254988 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: Accept: application/json Jun 16 18:46:04.254988 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: Accept-Encoding: identity Jun 16 18:46:04.254988 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: Connection: close Jun 16 18:46:04.254988 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: Content-Length: 0 Jun 16 18:46:04.254988 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: Content-Type: application/json Jun 16 18:46:04.254988 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: Host: 10.222.0.30 Jun 16 18:46:04.254988 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: Openstack-System-Scope: None Jun 16 18:46:04.254988 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: User-Agent: python-urllib3/1.26.9 Jun 16 18:46:04.254988 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Auth-Token: gAAAAABiq3jY4R2XLaMoSQFIu108GrgbWK1ZzxrQvtOfRnw0Fi7O9DZ8rIZHp31j8YpKZy1pG3APpQTkFQ8ZcpOFpRMLDOipcXGngfnUS2RmLkdps5xgUNxPEFSLbWH5Xb-i7Mi-7CjVAaASuV92Mj_CZi7D75bg6gQCu-jW8y7G9SDpsOOfj5o Jun 16 18:46:04.254988 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Domain-Id: None Jun 16 18:46:04.254988 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Domain-Name: None Jun 16 18:46:04.254988 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Identity-Status: Confirmed Jun 16 18:46:04.254988 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Is-Admin-Project: True Jun 16 18:46:04.254988 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Project-Domain-Id: default Jun 16 18:46:04.254988 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Project-Domain-Name: Default Jun 16 18:46:04.254988 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Project-Id: dff4784f6ab3499b88cb38c81780b754 Jun 16 18:46:04.254988 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Project-Name: tempest-TestVolumeBootPattern-539061139 Jun 16 18:46:04.254988 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Role: reader,member Jun 16 18:46:04.254988 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Roles: reader,member Jun 16 18:46:04.258111 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/dff4784f6ab3499b88cb38c81780b754"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/dff4784f6ab3499b88cb38c81780b754"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_dff4784f6ab3499b88cb38c81780b754", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/dff4784f6ab3499b88cb38c81780b754"}]}] Jun 16 18:46:04.258111 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Tenant: tempest-TestVolumeBootPattern-539061139 Jun 16 18:46:04.258111 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Tenant-Id: dff4784f6ab3499b88cb38c81780b754 Jun 16 18:46:04.258111 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Tenant-Name: tempest-TestVolumeBootPattern-539061139 Jun 16 18:46:04.258111 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-User: tempest-TestVolumeBootPattern-539061139-project Jun 16 18:46:04.258111 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-User-Domain-Id: default Jun 16 18:46:04.258111 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-User-Domain-Name: Default Jun 16 18:46:04.258111 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-User-Id: e5cbf8d443de4a9fb627ef316fbd033f Jun 16 18:46:04.258111 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-User-Name: tempest-TestVolumeBootPattern-539061139-project Jun 16 18:46:04.258111 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: method: > Jun 16 18:46:04.258111 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: exception: Instance 018f27c2-c42a-4d5e-8353-0a67ecd1d96c could not be found. Jun 16 18:46:04.258111 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: action_args: {'id': '018f27c2-c42a-4d5e-8353-0a67ecd1d96c'} Jun 16 18:46:04.259893 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:46:04.259893 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:46:04.259893 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 18:46:04.259893 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 18:46:04.259893 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 18:46:04.259893 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 18:46:04.259893 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 18:46:04.259893 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 18:46:04.259893 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 18:46:04.259893 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 18:46:04.259893 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 018f27c2-c42a-4d5e-8353-0a67ecd1d96c could not be found. Jun 16 18:46:04.259893 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Jun 16 18:46:04.259893 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:46:04.259893 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Jun 16 18:46:04.259893 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:46:04.259893 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:46:04.259893 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:46:04.259893 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:46:04.259893 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:46:04.259893 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:46:04.262851 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:46:04.262851 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 18:46:04.262851 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 18:46:04.262851 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 18:46:04.262851 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 18:46:04.262851 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 18:46:04.262851 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:46:04.262851 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 018f27c2-c42a-4d5e-8353-0a67ecd1d96c could not be found. Jun 16 18:46:04.262851 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Jun 16 18:46:04.262851 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:46:04.262851 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Jun 16 18:46:04.262851 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:46:04.262851 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:46:04.262851 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:46:04.262851 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:46:04.262851 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:46:04.262851 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 018f27c2-c42a-4d5e-8353-0a67ecd1d96c could not be found. Jun 16 18:46:04.262851 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Jun 16 18:46:04.265133 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-5abdc4d6-aba8-44e1-8053-ec3218304e48 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Returning 404 to user: Instance 018f27c2-c42a-4d5e-8353-0a67ecd1d96c could not be found. {{(pid=117671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:46:04.265133 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-5abdc4d6-aba8-44e1-8053-ec3218304e48 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] 10.222.0.30 "GET /compute/v2.1/servers/018f27c2-c42a-4d5e-8353-0a67ecd1d96c" status: 404 len: 111 microversion: 2.1 time: 0.034751 Jun 16 18:46:04.265133 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 500/1036] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:46:04 2022] GET /compute/v2.1/servers/018f27c2-c42a-4d5e-8353-0a67ecd1d96c => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:46:07.657180 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [req-ad95015e-f461-4338-a59d-ab0dcde20bcd req-89b084f8-508d-49a4-8cbc-0102e8517093 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "07a8c30d-1b9a-422f-83c3-be1fa6bffe05", "tag": "3795d114-2dd6-4ca8-8bb7-3dcaf8cde487"}]} {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:46:07.659590 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-72b57644-24ee-4a4f-b7ef-d74a13bb1b57 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:46:07.660603 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-72b57644-24ee-4a4f-b7ef-d74a13bb1b57 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] [instance: 07a8c30d-1b9a-422f-83c3-be1fa6bffe05] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:46:07.672465 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [req-ad95015e-f461-4338-a59d-ab0dcde20bcd req-89b084f8-508d-49a4-8cbc-0102e8517093 service nova] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:46:07.673206 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [req-ad95015e-f461-4338-a59d-ab0dcde20bcd req-89b084f8-508d-49a4-8cbc-0102e8517093 service nova] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:46:07.680108 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-72b57644-24ee-4a4f-b7ef-d74a13bb1b57 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:46:07.681501 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-72b57644-24ee-4a4f-b7ef-d74a13bb1b57 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:46:07.683285 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-72b57644-24ee-4a4f-b7ef-d74a13bb1b57 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:46:07.685138 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-72b57644-24ee-4a4f-b7ef-d74a13bb1b57 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:46:07.689481 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.compute.server_external_events [req-ad95015e-f461-4338-a59d-ab0dcde20bcd req-89b084f8-508d-49a4-8cbc-0102e8517093 service nova] Creating event network-changed:3795d114-2dd6-4ca8-8bb7-3dcaf8cde487 for instance 07a8c30d-1b9a-422f-83c3-be1fa6bffe05 on hv-cinder-81322 Jun 16 18:46:07.695515 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [req-ad95015e-f461-4338-a59d-ab0dcde20bcd req-89b084f8-508d-49a4-8cbc-0102e8517093 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042289 Jun 16 18:46:07.696245 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 501/1037] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Jun 16 18:46:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 18:46:07.735900 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-72b57644-24ee-4a4f-b7ef-d74a13bb1b57 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] [instance: 07a8c30d-1b9a-422f-83c3-be1fa6bffe05] Going to try to terminate instance {{(pid=117670) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 18:46:07.898010 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-72b57644-24ee-4a4f-b7ef-d74a13bb1b57 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] 10.222.0.30 "DELETE /compute/v2.1/servers/07a8c30d-1b9a-422f-83c3-be1fa6bffe05" status: 204 len: 0 microversion: 2.1 time: 0.246000 Jun 16 18:46:07.905040 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 537/1038] 10.222.0.30 () {58 vars in 1238 bytes} [Thu Jun 16 18:46:07 2022] DELETE /compute/v2.1/servers/07a8c30d-1b9a-422f-83c3-be1fa6bffe05 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 18:46:07.916252 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-78c87ae4-e448-4e2b-9a9b-cf62bcc08cb2 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:46:07.917586 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-78c87ae4-e448-4e2b-9a9b-cf62bcc08cb2 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] [instance: 07a8c30d-1b9a-422f-83c3-be1fa6bffe05] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:46:07.931617 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-78c87ae4-e448-4e2b-9a9b-cf62bcc08cb2 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:46:07.933046 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-78c87ae4-e448-4e2b-9a9b-cf62bcc08cb2 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:46:07.934939 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-78c87ae4-e448-4e2b-9a9b-cf62bcc08cb2 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:46:07.935999 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-78c87ae4-e448-4e2b-9a9b-cf62bcc08cb2 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:46:08.173480 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.policy [None req-78c87ae4-e448-4e2b-9a9b-cf62bcc08cb2 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5cbf8d443de4a9fb627ef316fbd033f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff4784f6ab3499b88cb38c81780b754', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117671) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:46:08.183558 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-78c87ae4-e448-4e2b-9a9b-cf62bcc08cb2 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] 10.222.0.30 "GET /compute/v2.1/servers/07a8c30d-1b9a-422f-83c3-be1fa6bffe05" status: 200 len: 1579 microversion: 2.1 time: 0.276321 Jun 16 18:46:08.184935 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 502/1039] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:46:07 2022] GET /compute/v2.1/servers/07a8c30d-1b9a-422f-83c3-be1fa6bffe05 => generated 1579 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:46:09.207356 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-8f1b8a85-a46d-4e1e-8c43-b6cad3a39ff2 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:46:09.208825 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-8f1b8a85-a46d-4e1e-8c43-b6cad3a39ff2 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] [instance: 07a8c30d-1b9a-422f-83c3-be1fa6bffe05] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:46:09.216807 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-8f1b8a85-a46d-4e1e-8c43-b6cad3a39ff2 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:46:09.217266 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-8f1b8a85-a46d-4e1e-8c43-b6cad3a39ff2 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:46:09.218079 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-8f1b8a85-a46d-4e1e-8c43-b6cad3a39ff2 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:46:09.218522 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-8f1b8a85-a46d-4e1e-8c43-b6cad3a39ff2 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:46:09.532869 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-8f1b8a85-a46d-4e1e-8c43-b6cad3a39ff2 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5cbf8d443de4a9fb627ef316fbd033f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff4784f6ab3499b88cb38c81780b754', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:46:09.547857 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-8f1b8a85-a46d-4e1e-8c43-b6cad3a39ff2 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] 10.222.0.30 "GET /compute/v2.1/servers/07a8c30d-1b9a-422f-83c3-be1fa6bffe05" status: 200 len: 1579 microversion: 2.1 time: 0.345278 Jun 16 18:46:09.548854 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 538/1040] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:46:09 2022] GET /compute/v2.1/servers/07a8c30d-1b9a-422f-83c3-be1fa6bffe05 => generated 1579 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:46:10.133471 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [req-686e7df4-6dc9-455d-988a-503c528b0e70 req-56b7a5e4-ed5d-40e2-9e7a-2a6f8110f859 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "07a8c30d-1b9a-422f-83c3-be1fa6bffe05", "name": "network-vif-deleted", "tag": "3795d114-2dd6-4ca8-8bb7-3dcaf8cde487"}]} {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:46:10.149383 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [req-686e7df4-6dc9-455d-988a-503c528b0e70 req-56b7a5e4-ed5d-40e2-9e7a-2a6f8110f859 service nova] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:46:10.149838 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [req-686e7df4-6dc9-455d-988a-503c528b0e70 req-56b7a5e4-ed5d-40e2-9e7a-2a6f8110f859 service nova] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:46:10.163359 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.compute.server_external_events [req-686e7df4-6dc9-455d-988a-503c528b0e70 req-56b7a5e4-ed5d-40e2-9e7a-2a6f8110f859 service nova] Creating event network-vif-deleted:3795d114-2dd6-4ca8-8bb7-3dcaf8cde487 for instance 07a8c30d-1b9a-422f-83c3-be1fa6bffe05 on hv-cinder-81322 Jun 16 18:46:10.169855 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [req-686e7df4-6dc9-455d-988a-503c528b0e70 req-56b7a5e4-ed5d-40e2-9e7a-2a6f8110f859 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045699 Jun 16 18:46:10.170840 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 503/1041] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Jun 16 18:46:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:46:10.586679 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-0e4aba03-0763-4837-9914-6326c93721ea tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:46:10.588237 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-0e4aba03-0763-4837-9914-6326c93721ea tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] [instance: 07a8c30d-1b9a-422f-83c3-be1fa6bffe05] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:46:10.596363 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-0e4aba03-0763-4837-9914-6326c93721ea tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:46:10.596816 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-0e4aba03-0763-4837-9914-6326c93721ea tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:46:10.597603 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-0e4aba03-0763-4837-9914-6326c93721ea tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:46:10.598044 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-0e4aba03-0763-4837-9914-6326c93721ea tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:46:10.640886 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-0e4aba03-0763-4837-9914-6326c93721ea tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:46:10.641572 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-0e4aba03-0763-4837-9914-6326c93721ea tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:46:10.642350 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.objects.instance [None req-0e4aba03-0763-4837-9914-6326c93721ea tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Lazy-loading 'fault' on Instance uuid 07a8c30d-1b9a-422f-83c3-be1fa6bffe05 {{(pid=117670) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 18:46:10.698721 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.policy [None req-0e4aba03-0763-4837-9914-6326c93721ea tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5cbf8d443de4a9fb627ef316fbd033f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff4784f6ab3499b88cb38c81780b754', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:46:10.709848 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-0e4aba03-0763-4837-9914-6326c93721ea tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] 10.222.0.30 "GET /compute/v2.1/servers/07a8c30d-1b9a-422f-83c3-be1fa6bffe05" status: 200 len: 1230 microversion: 2.1 time: 0.137798 Jun 16 18:46:10.710746 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 539/1042] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:46:10 2022] GET /compute/v2.1/servers/07a8c30d-1b9a-422f-83c3-be1fa6bffe05 => generated 1230 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:46:11.742469 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-38ce7bce-0f59-428d-a8ee-8d83de0be0cc tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:46:11.743629 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-38ce7bce-0f59-428d-a8ee-8d83de0be0cc tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] [instance: 07a8c30d-1b9a-422f-83c3-be1fa6bffe05] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:46:11.752586 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-38ce7bce-0f59-428d-a8ee-8d83de0be0cc tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:46:11.753109 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-38ce7bce-0f59-428d-a8ee-8d83de0be0cc tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:46:11.754112 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-38ce7bce-0f59-428d-a8ee-8d83de0be0cc tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:46:11.754774 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-38ce7bce-0f59-428d-a8ee-8d83de0be0cc tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:46:11.776105 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.wsgi [None req-38ce7bce-0f59-428d-a8ee-8d83de0be0cc tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] HTTP exception thrown: Instance 07a8c30d-1b9a-422f-83c3-be1fa6bffe05 could not be found. Jun 16 18:46:11.778914 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-38ce7bce-0f59-428d-a8ee-8d83de0be0cc tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Request method failure captured: Jun 16 18:46:11.778914 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: request: GET /compute/v2.1/servers/07a8c30d-1b9a-422f-83c3-be1fa6bffe05 HTTP/1.1 Jun 16 18:46:11.778914 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: Accept: application/json Jun 16 18:46:11.778914 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: Accept-Encoding: identity Jun 16 18:46:11.778914 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: Connection: close Jun 16 18:46:11.778914 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: Content-Length: 0 Jun 16 18:46:11.778914 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: Content-Type: application/json Jun 16 18:46:11.778914 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: Host: 10.222.0.30 Jun 16 18:46:11.778914 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: Openstack-System-Scope: None Jun 16 18:46:11.778914 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: User-Agent: python-urllib3/1.26.9 Jun 16 18:46:11.778914 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Auth-Token: gAAAAABiq3jY4R2XLaMoSQFIu108GrgbWK1ZzxrQvtOfRnw0Fi7O9DZ8rIZHp31j8YpKZy1pG3APpQTkFQ8ZcpOFpRMLDOipcXGngfnUS2RmLkdps5xgUNxPEFSLbWH5Xb-i7Mi-7CjVAaASuV92Mj_CZi7D75bg6gQCu-jW8y7G9SDpsOOfj5o Jun 16 18:46:11.778914 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Domain-Id: None Jun 16 18:46:11.778914 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Domain-Name: None Jun 16 18:46:11.778914 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Identity-Status: Confirmed Jun 16 18:46:11.778914 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Is-Admin-Project: True Jun 16 18:46:11.778914 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Project-Domain-Id: default Jun 16 18:46:11.778914 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Project-Domain-Name: Default Jun 16 18:46:11.778914 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Project-Id: dff4784f6ab3499b88cb38c81780b754 Jun 16 18:46:11.778914 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Project-Name: tempest-TestVolumeBootPattern-539061139 Jun 16 18:46:11.778914 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Role: reader,member Jun 16 18:46:11.778914 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Roles: reader,member Jun 16 18:46:11.780544 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/dff4784f6ab3499b88cb38c81780b754"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/dff4784f6ab3499b88cb38c81780b754"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_dff4784f6ab3499b88cb38c81780b754", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/dff4784f6ab3499b88cb38c81780b754"}]}] Jun 16 18:46:11.780544 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Tenant: tempest-TestVolumeBootPattern-539061139 Jun 16 18:46:11.780544 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Tenant-Id: dff4784f6ab3499b88cb38c81780b754 Jun 16 18:46:11.780544 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Tenant-Name: tempest-TestVolumeBootPattern-539061139 Jun 16 18:46:11.780544 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-User: tempest-TestVolumeBootPattern-539061139-project Jun 16 18:46:11.780544 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-User-Domain-Id: default Jun 16 18:46:11.780544 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-User-Domain-Name: Default Jun 16 18:46:11.780544 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-User-Id: e5cbf8d443de4a9fb627ef316fbd033f Jun 16 18:46:11.780544 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-User-Name: tempest-TestVolumeBootPattern-539061139-project Jun 16 18:46:11.780544 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: method: > Jun 16 18:46:11.780544 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: exception: Instance 07a8c30d-1b9a-422f-83c3-be1fa6bffe05 could not be found. Jun 16 18:46:11.780544 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: action_args: {'id': '07a8c30d-1b9a-422f-83c3-be1fa6bffe05'} Jun 16 18:46:11.781367 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:46:11.781367 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:46:11.781367 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 18:46:11.781367 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 18:46:11.781367 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 18:46:11.781367 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 18:46:11.781367 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 18:46:11.781367 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 18:46:11.781367 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 18:46:11.781367 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 18:46:11.781367 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 07a8c30d-1b9a-422f-83c3-be1fa6bffe05 could not be found. Jun 16 18:46:11.781367 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Jun 16 18:46:11.781367 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:46:11.781367 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Jun 16 18:46:11.781367 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:46:11.781367 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:46:11.781367 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:46:11.781367 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:46:11.781367 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:46:11.781367 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:46:11.782727 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:46:11.782727 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 18:46:11.782727 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 18:46:11.782727 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 18:46:11.782727 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 18:46:11.782727 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 18:46:11.782727 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:46:11.782727 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 07a8c30d-1b9a-422f-83c3-be1fa6bffe05 could not be found. Jun 16 18:46:11.782727 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Jun 16 18:46:11.782727 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:46:11.782727 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Jun 16 18:46:11.782727 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:46:11.782727 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:46:11.782727 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:46:11.782727 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:46:11.782727 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:46:11.782727 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 07a8c30d-1b9a-422f-83c3-be1fa6bffe05 could not be found. Jun 16 18:46:11.782727 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Jun 16 18:46:11.784731 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-38ce7bce-0f59-428d-a8ee-8d83de0be0cc tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Returning 404 to user: Instance 07a8c30d-1b9a-422f-83c3-be1fa6bffe05 could not be found. {{(pid=117671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:46:11.784731 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-38ce7bce-0f59-428d-a8ee-8d83de0be0cc tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] 10.222.0.30 "GET /compute/v2.1/servers/07a8c30d-1b9a-422f-83c3-be1fa6bffe05" status: 404 len: 111 microversion: 2.1 time: 0.048048 Jun 16 18:46:11.784731 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 504/1043] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:46:11 2022] GET /compute/v2.1/servers/07a8c30d-1b9a-422f-83c3-be1fa6bffe05 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:46:12.333627 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-c0298783-4c24-4618-b571-cd7d0955a2b7 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Calling method '>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:46:12.334804 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.compute.api [None req-c0298783-4c24-4618-b571-cd7d0955a2b7 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] [instance: d7463e71-d7d9-406e-97b0-5ab1dc992c9b] Fetching instance by UUID {{(pid=117670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:46:12.342370 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-c0298783-4c24-4618-b571-cd7d0955a2b7 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:46:12.342818 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-c0298783-4c24-4618-b571-cd7d0955a2b7 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:46:12.343613 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-c0298783-4c24-4618-b571-cd7d0955a2b7 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:46:12.344068 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG oslo_concurrency.lockutils [None req-c0298783-4c24-4618-b571-cd7d0955a2b7 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:46:12.359888 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.wsgi [None req-c0298783-4c24-4618-b571-cd7d0955a2b7 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] HTTP exception thrown: Instance d7463e71-d7d9-406e-97b0-5ab1dc992c9b could not be found. Jun 16 18:46:12.361662 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-c0298783-4c24-4618-b571-cd7d0955a2b7 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Request method failure captured: Jun 16 18:46:12.361662 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: request: DELETE /compute/v2.1/servers/d7463e71-d7d9-406e-97b0-5ab1dc992c9b HTTP/1.1 Jun 16 18:46:12.361662 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: Accept: application/json Jun 16 18:46:12.361662 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: Accept-Encoding: identity Jun 16 18:46:12.361662 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: Connection: close Jun 16 18:46:12.361662 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: Content-Length: 0 Jun 16 18:46:12.361662 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: Content-Type: application/json Jun 16 18:46:12.361662 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: Host: 10.222.0.30 Jun 16 18:46:12.361662 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: Openstack-System-Scope: None Jun 16 18:46:12.361662 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: User-Agent: python-urllib3/1.26.9 Jun 16 18:46:12.361662 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Auth-Token: gAAAAABiq3jY4R2XLaMoSQFIu108GrgbWK1ZzxrQvtOfRnw0Fi7O9DZ8rIZHp31j8YpKZy1pG3APpQTkFQ8ZcpOFpRMLDOipcXGngfnUS2RmLkdps5xgUNxPEFSLbWH5Xb-i7Mi-7CjVAaASuV92Mj_CZi7D75bg6gQCu-jW8y7G9SDpsOOfj5o Jun 16 18:46:12.361662 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Domain-Id: None Jun 16 18:46:12.361662 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Domain-Name: None Jun 16 18:46:12.361662 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Identity-Status: Confirmed Jun 16 18:46:12.361662 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Is-Admin-Project: True Jun 16 18:46:12.361662 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Project-Domain-Id: default Jun 16 18:46:12.361662 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Project-Domain-Name: Default Jun 16 18:46:12.361662 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Project-Id: dff4784f6ab3499b88cb38c81780b754 Jun 16 18:46:12.361662 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Project-Name: tempest-TestVolumeBootPattern-539061139 Jun 16 18:46:12.361662 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Role: reader,member Jun 16 18:46:12.361662 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Roles: reader,member Jun 16 18:46:12.363278 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/dff4784f6ab3499b88cb38c81780b754"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/dff4784f6ab3499b88cb38c81780b754"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_dff4784f6ab3499b88cb38c81780b754", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/dff4784f6ab3499b88cb38c81780b754"}]}] Jun 16 18:46:12.363278 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Tenant: tempest-TestVolumeBootPattern-539061139 Jun 16 18:46:12.363278 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Tenant-Id: dff4784f6ab3499b88cb38c81780b754 Jun 16 18:46:12.363278 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-Tenant-Name: tempest-TestVolumeBootPattern-539061139 Jun 16 18:46:12.363278 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-User: tempest-TestVolumeBootPattern-539061139-project Jun 16 18:46:12.363278 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-User-Domain-Id: default Jun 16 18:46:12.363278 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-User-Domain-Name: Default Jun 16 18:46:12.363278 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-User-Id: e5cbf8d443de4a9fb627ef316fbd033f Jun 16 18:46:12.363278 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: X-User-Name: tempest-TestVolumeBootPattern-539061139-project Jun 16 18:46:12.363278 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: method: > Jun 16 18:46:12.363278 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: exception: Instance d7463e71-d7d9-406e-97b0-5ab1dc992c9b could not be found. Jun 16 18:46:12.363278 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: action_args: {'id': 'd7463e71-d7d9-406e-97b0-5ab1dc992c9b'} Jun 16 18:46:12.364185 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:46:12.364185 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:46:12.364185 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 18:46:12.364185 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 18:46:12.364185 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 18:46:12.364185 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 18:46:12.364185 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 18:46:12.364185 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 18:46:12.364185 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 18:46:12.364185 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 18:46:12.364185 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d7463e71-d7d9-406e-97b0-5ab1dc992c9b could not be found. Jun 16 18:46:12.364185 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi Jun 16 18:46:12.364185 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:46:12.364185 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi Jun 16 18:46:12.364185 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:46:12.364185 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:46:12.364185 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:46:12.364185 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:46:12.364185 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:46:12.364185 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:46:12.365882 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:46:12.365882 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 16 18:46:12.365882 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 16 18:46:12.365882 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 16 18:46:12.365882 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 16 18:46:12.365882 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 18:46:12.365882 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 18:46:12.365882 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 18:46:12.365882 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:46:12.365882 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d7463e71-d7d9-406e-97b0-5ab1dc992c9b could not be found. Jun 16 18:46:12.365882 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi Jun 16 18:46:12.365882 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:46:12.365882 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi Jun 16 18:46:12.365882 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:46:12.365882 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:46:12.365882 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:46:12.365882 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:46:12.365882 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:46:12.365882 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d7463e71-d7d9-406e-97b0-5ab1dc992c9b could not be found. Jun 16 18:46:12.365882 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: ERROR nova.api.openstack.wsgi Jun 16 18:46:12.367606 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-c0298783-4c24-4618-b571-cd7d0955a2b7 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Returning 404 to user: Instance d7463e71-d7d9-406e-97b0-5ab1dc992c9b could not be found. {{(pid=117670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:46:12.367606 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-c0298783-4c24-4618-b571-cd7d0955a2b7 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] 10.222.0.30 "DELETE /compute/v2.1/servers/d7463e71-d7d9-406e-97b0-5ab1dc992c9b" status: 404 len: 111 microversion: 2.1 time: 0.034066 Jun 16 18:46:12.367606 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 540/1044] 10.222.0.30 () {58 vars in 1238 bytes} [Thu Jun 16 18:46:12 2022] DELETE /compute/v2.1/servers/d7463e71-d7d9-406e-97b0-5ab1dc992c9b => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:46:12.372896 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-fd8e21e4-37ba-4962-b0c6-9739a145635e tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Calling method '>' {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:46:12.373556 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.compute.api [None req-fd8e21e4-37ba-4962-b0c6-9739a145635e tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] [instance: d7463e71-d7d9-406e-97b0-5ab1dc992c9b] Fetching instance by UUID {{(pid=117671) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:46:12.380799 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-fd8e21e4-37ba-4962-b0c6-9739a145635e tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:46:12.381263 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-fd8e21e4-37ba-4962-b0c6-9739a145635e tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:46:12.382082 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-fd8e21e4-37ba-4962-b0c6-9739a145635e tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:46:12.382539 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG oslo_concurrency.lockutils [None req-fd8e21e4-37ba-4962-b0c6-9739a145635e tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Lock "aeb18649-0c63-4d1d-a910-334eb7a21817" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117671) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:46:12.399170 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.wsgi [None req-fd8e21e4-37ba-4962-b0c6-9739a145635e tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] HTTP exception thrown: Instance d7463e71-d7d9-406e-97b0-5ab1dc992c9b could not be found. Jun 16 18:46:12.400924 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-fd8e21e4-37ba-4962-b0c6-9739a145635e tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Request method failure captured: Jun 16 18:46:12.400924 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: request: GET /compute/v2.1/servers/d7463e71-d7d9-406e-97b0-5ab1dc992c9b HTTP/1.1 Jun 16 18:46:12.400924 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: Accept: application/json Jun 16 18:46:12.400924 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: Accept-Encoding: identity Jun 16 18:46:12.400924 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: Connection: close Jun 16 18:46:12.400924 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: Content-Length: 0 Jun 16 18:46:12.400924 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: Content-Type: application/json Jun 16 18:46:12.400924 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: Host: 10.222.0.30 Jun 16 18:46:12.400924 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: Openstack-System-Scope: None Jun 16 18:46:12.400924 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: User-Agent: python-urllib3/1.26.9 Jun 16 18:46:12.400924 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Auth-Token: gAAAAABiq3jY4R2XLaMoSQFIu108GrgbWK1ZzxrQvtOfRnw0Fi7O9DZ8rIZHp31j8YpKZy1pG3APpQTkFQ8ZcpOFpRMLDOipcXGngfnUS2RmLkdps5xgUNxPEFSLbWH5Xb-i7Mi-7CjVAaASuV92Mj_CZi7D75bg6gQCu-jW8y7G9SDpsOOfj5o Jun 16 18:46:12.400924 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Domain-Id: None Jun 16 18:46:12.400924 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Domain-Name: None Jun 16 18:46:12.400924 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Identity-Status: Confirmed Jun 16 18:46:12.400924 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Is-Admin-Project: True Jun 16 18:46:12.400924 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Project-Domain-Id: default Jun 16 18:46:12.400924 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Project-Domain-Name: Default Jun 16 18:46:12.400924 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Project-Id: dff4784f6ab3499b88cb38c81780b754 Jun 16 18:46:12.400924 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Project-Name: tempest-TestVolumeBootPattern-539061139 Jun 16 18:46:12.400924 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Role: reader,member Jun 16 18:46:12.400924 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Roles: reader,member Jun 16 18:46:12.403634 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/dff4784f6ab3499b88cb38c81780b754"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/dff4784f6ab3499b88cb38c81780b754"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_dff4784f6ab3499b88cb38c81780b754", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/dff4784f6ab3499b88cb38c81780b754"}]}] Jun 16 18:46:12.403634 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Tenant: tempest-TestVolumeBootPattern-539061139 Jun 16 18:46:12.403634 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Tenant-Id: dff4784f6ab3499b88cb38c81780b754 Jun 16 18:46:12.403634 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-Tenant-Name: tempest-TestVolumeBootPattern-539061139 Jun 16 18:46:12.403634 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-User: tempest-TestVolumeBootPattern-539061139-project Jun 16 18:46:12.403634 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-User-Domain-Id: default Jun 16 18:46:12.403634 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-User-Domain-Name: Default Jun 16 18:46:12.403634 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-User-Id: e5cbf8d443de4a9fb627ef316fbd033f Jun 16 18:46:12.403634 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: X-User-Name: tempest-TestVolumeBootPattern-539061139-project Jun 16 18:46:12.403634 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: method: > Jun 16 18:46:12.403634 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: exception: Instance d7463e71-d7d9-406e-97b0-5ab1dc992c9b could not be found. Jun 16 18:46:12.403634 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: action_args: {'id': 'd7463e71-d7d9-406e-97b0-5ab1dc992c9b'} Jun 16 18:46:12.406048 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: {{(pid=117671) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:46:12.406048 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:46:12.406048 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 18:46:12.406048 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 18:46:12.406048 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 18:46:12.406048 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 18:46:12.406048 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 18:46:12.406048 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 18:46:12.406048 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 18:46:12.406048 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 18:46:12.406048 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d7463e71-d7d9-406e-97b0-5ab1dc992c9b could not be found. Jun 16 18:46:12.406048 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Jun 16 18:46:12.406048 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:46:12.406048 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Jun 16 18:46:12.406048 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:46:12.406048 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:46:12.406048 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:46:12.406048 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:46:12.406048 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:46:12.406048 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:46:12.409394 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:46:12.409394 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 18:46:12.409394 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 18:46:12.409394 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 18:46:12.409394 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 18:46:12.409394 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 18:46:12.409394 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:46:12.409394 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d7463e71-d7d9-406e-97b0-5ab1dc992c9b could not be found. Jun 16 18:46:12.409394 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Jun 16 18:46:12.409394 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:46:12.409394 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Jun 16 18:46:12.409394 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:46:12.409394 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:46:12.409394 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:46:12.409394 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:46:12.409394 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:46:12.409394 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d7463e71-d7d9-406e-97b0-5ab1dc992c9b could not be found. Jun 16 18:46:12.409394 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: ERROR nova.api.openstack.wsgi Jun 16 18:46:12.412880 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: DEBUG nova.api.openstack.wsgi [None req-fd8e21e4-37ba-4962-b0c6-9739a145635e tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Returning 404 to user: Instance d7463e71-d7d9-406e-97b0-5ab1dc992c9b could not be found. {{(pid=117671) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:46:12.412880 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO nova.api.openstack.requestlog [None req-fd8e21e4-37ba-4962-b0c6-9739a145635e tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] 10.222.0.30 "GET /compute/v2.1/servers/d7463e71-d7d9-406e-97b0-5ab1dc992c9b" status: 404 len: 111 microversion: 2.1 time: 0.033560 Jun 16 18:46:12.412880 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: [pid: 117671|app: 0|req: 505/1045] 10.222.0.30 () {58 vars in 1235 bytes} [Thu Jun 16 18:46:12 2022] GET /compute/v2.1/servers/d7463e71-d7d9-406e-97b0-5ab1dc992c9b => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:46:13.797551 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: DEBUG nova.api.openstack.wsgi [None req-41fa6825-69a2-4e9a-ae0f-801c0c381e10 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] Calling method '.version_select at 0x7fbb3470dee0>' {{(pid=117670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:46:13.831962 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO nova.api.openstack.requestlog [None req-41fa6825-69a2-4e9a-ae0f-801c0c381e10 tempest-TestVolumeBootPattern-539061139 tempest-TestVolumeBootPattern-539061139-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1062823508" status: 202 len: 0 microversion: 2.1 time: 0.038893 Jun 16 18:46:13.833537 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: [pid: 117670|app: 0|req: 541/1046] 10.222.0.30 () {58 vars in 1262 bytes} [Thu Jun 16 18:46:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1062823508 => generated 0 bytes in 41 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 18:47:11.060725 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 16 18:47:11.061660 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: Thu Jun 16 18:47:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 16 18:47:11.264404 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 16 18:47:11.265374 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: Thu Jun 16 18:47:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 16 18:48:40.887714 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 16 18:48:40.888518 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: Thu Jun 16 18:48:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 16 18:48:45.639651 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 16 18:48:45.641144 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: Thu Jun 16 18:48:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 16 18:49:18.088121 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 16 18:49:18.089178 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: Thu Jun 16 18:49:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 16 18:49:19.883403 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 16 18:49:19.884719 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: Thu Jun 16 18:49:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 16 18:50:31.071805 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 16 18:50:31.072909 dv-cinder-813229-10-iscsi devstack@n-api.service[117671]: Thu Jun 16 18:50:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 16 18:50:31.275924 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 16 18:50:31.276654 dv-cinder-813229-10-iscsi devstack@n-api.service[117670]: Thu Jun 16 18:50:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!